-- Logs begin at Wed 2022-09-07 12:21:04 UTC, end at Wed 2022-09-07 13:42:34 UTC. -- Sep 07 12:57:46.126970 dv-cinder-804035-50-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 07 12:57:46.134412 dv-cinder-804035-50-smb devstack@keystone.service[81805]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 12:57:46 2022] *** Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: nodename: dv-cinder-804035-50-smb Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: machine: x86_64 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: clock source: unix Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: pcre jit disabled Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: detected number of CPU cores: 4 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: current working directory: / Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: detected binary path: /usr/bin/uwsgi-core Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: your processes number limit is 47680 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: your memory page size is 4096 bytes Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: detected max file descriptor number: 2048 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: lock engine: pthread robust mutexes Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: thunder lock: enabled Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 07 12:57:46.138413 dv-cinder-804035-50-smb devstack@keystone.service[81805]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 12:57:46.180064 dv-cinder-804035-50-smb devstack@keystone.service[81805]: Python main interpreter initialized at 0x559efe0359c0 Sep 07 12:57:46.180064 dv-cinder-804035-50-smb devstack@keystone.service[81805]: python threads support enabled Sep 07 12:57:46.180064 dv-cinder-804035-50-smb devstack@keystone.service[81805]: your server socket listen backlog is limited to 100 connections Sep 07 12:57:46.180064 dv-cinder-804035-50-smb devstack@keystone.service[81805]: your mercy for graceful operations on workers is 90 seconds Sep 07 12:57:46.180454 dv-cinder-804035-50-smb devstack@keystone.service[81805]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 12:57:46.180533 dv-cinder-804035-50-smb devstack@keystone.service[81805]: *** Operational MODE: preforking *** Sep 07 12:57:46.180789 dv-cinder-804035-50-smb devstack@keystone.service[81805]: *** uWSGI is running in multiple interpreter mode *** Sep 07 12:57:46.180789 dv-cinder-804035-50-smb devstack@keystone.service[81805]: spawned uWSGI master process (pid: 81805) Sep 07 12:57:46.180996 dv-cinder-804035-50-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 07 12:57:46.182540 dv-cinder-804035-50-smb devstack@keystone.service[81805]: spawned uWSGI worker 1 (pid: 81818, cores: 1) Sep 07 12:57:46.182540 dv-cinder-804035-50-smb devstack@keystone.service[81805]: spawned uWSGI worker 2 (pid: 81819, cores: 1) Sep 07 12:57:46.182540 dv-cinder-804035-50-smb devstack@keystone.service[81805]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 12:57:50.573240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:50.573240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: from cryptography.utils import int_from_bytes Sep 07 12:57:50.574015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:50.574015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: from cryptography.utils import int_from_bytes Sep 07 12:57:50.574126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:50.574126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: from cryptography.utils import int_from_bytes Sep 07 12:57:50.574126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 12:57:50.574126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: from cryptography.utils import int_from_bytes Sep 07 12:57:50.628925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:57:50.629097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 12:57:50.629188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:57:50.629302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 12:57:50.629432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] command line args: [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:57:50.629506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] command line args: [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 12:57:50.629571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:57:50.629733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ================================================================================ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:57:50.629856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 12:57:50.629952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ================================================================================ {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 12:57:50.630166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] admin_token = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.630415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] config_dir = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.630601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.630734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] admin_token = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.630824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] config_source = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.630947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] debug = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.631147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.631513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.631689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.631910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config_dir = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.632224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.632328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.632524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.632759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.632941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_config_append = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.633089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] config_source = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.633181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.633283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_dir = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.633522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_file = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.633727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] debug = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.633829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.634002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.634252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.634423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.634543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.634662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.634839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.635991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.636225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.636374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.636615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.636857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.636962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.637108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.637385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.637503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_config_append = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.637803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.637904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] publish_errors = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_dir = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.638922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.639030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.639270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.639378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.640292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] standard_threads = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.640415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.640497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.640563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.640634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.641974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] use_journal = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] use_json = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] use_stderr = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] use_syslog = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.642948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.643060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.643255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.643545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.643641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.643714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] publish_errors = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.643820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.643951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.644074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.644239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.644373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.644473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.644608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.644687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.644837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.644919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.645073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] standard_threads = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.645163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.645300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.645387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.645549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.645638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.645777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.645929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.645994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_journal = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.646057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.646121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_json = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.646275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_stderr = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.646358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.646431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] use_syslog = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.646602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.646671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 12:57:50.646730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.646870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.646949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.647978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.648964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.649888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.650964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.651929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.652922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.653060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.653189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.653326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.653857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.653997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.654935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.655068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.655777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.655948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.656153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.656300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.656430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.656559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.656698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.656981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.658041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.658276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.658592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.658825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.659032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.659260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.659478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.659643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.659854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.660126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.660398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.660595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.660912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.661081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.661245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.661406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.661575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.661717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.661889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.662057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.662216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.662420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.662554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.662724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.662888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.663941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.664110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.664259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.664392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.664522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.665277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.665439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.665600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.665810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.666922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.667974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.668152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.668327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.668478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.668478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.668791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.668970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.669113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.669113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.669363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.669495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.669623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.669858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.670006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.670006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.670258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.670415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.672994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.673945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.674914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.external = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.password = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] auth.token = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.675992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.676902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.external = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.677994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.password = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] auth.token = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.678947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.679968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.680970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.681926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.682888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.683972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.684945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.685898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.686936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.687904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.688918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.689980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.690967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.691896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.692962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.693939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694560 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.694964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.695974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.696913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.697973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.698921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.699062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.699211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.699362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.699556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.699702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.699860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.700971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.701120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.701269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.701418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.701569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.701732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.701887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.702569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.702692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.702808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.702932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.703925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.704964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.705118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.705271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.705422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.705582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.705739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.705891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.706958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.707107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.707256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.707414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.707569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.707720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.707865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.708004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.708254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] role.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.711795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.711951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] role.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.712962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.713898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.714958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.715882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.716967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.717082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.717198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.717314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.717437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.717554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.717717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.718334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.718453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.718610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.718610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.718815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.718912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.719975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.720977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.721971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.connection = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.722931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.723891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.724963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725558 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.725994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.726988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81818) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.727105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.728052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.728052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.728052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.728052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.728052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 12:57:50.728052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81819) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 12:57:50.749128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.749358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.749583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.751548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.751782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.752007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.758177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.760459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.787985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.788231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.789908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.790145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.850722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.851015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.900432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.900666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.901134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:50.901371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.073770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.073980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.074877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.075011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.075227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.106355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.106466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.106541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.106702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.106788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.106928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.107800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.118819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.119111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.131978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.132233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.132461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.132664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.132748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.132892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.132975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81818) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.133980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81819) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 07 12:57:51.150427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.150634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:57:51.150976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.151060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.151177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:57:51.151262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:57:51.151452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.151606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.151774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.151858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 07 12:57:51.152039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.152141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.152326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.152411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.152579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.152834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.162438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.162717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.162979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.163065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.163329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.163445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.163559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.163842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.170193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.171403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.173721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.174007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.174863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.174949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.175021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.175967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.176184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.176270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.176458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.176543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.176741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.177118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.199158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.199995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.201219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.201219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.201587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.201871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.205737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.206022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.206306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.206637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.206922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.207201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.212716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.213006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.213586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.213872 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.219261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.219564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.219853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.220160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.220243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.220438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.220519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.220712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.220794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.220989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.221068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.221259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.221348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.221556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.221832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.222101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.237296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.237574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.238283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.238562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.241502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.242434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.244830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.245128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.245697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.245998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.249393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.250324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.252595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.258507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.258595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.258595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.258595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.258595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.258905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.258975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.259047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.259112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.259182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.259182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.259182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.259182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.273826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.274117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.274383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.274647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.274843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.275133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.275403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.275666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.281651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.282792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.283192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.284406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.284829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.285107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.285985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.286261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.287789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.289461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.289461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.289461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.289762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.289838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.289924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.289924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.289924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.290272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.300920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.301204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.301485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.301769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.302065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.302154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.302350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.302479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.302631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.302711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.302910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.303289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.303569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.303856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.318761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.320102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.321692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.323862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.324672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.326070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.326153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.327551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.327639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.327910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.328291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.329146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.329427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.329818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.334745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.336225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.336411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.337861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.339109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.339505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.339794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.340180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.340814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.341211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.341496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.341775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.347932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.348286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.348578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.352569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.352569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.352569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.355507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81818) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.355794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.356077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.356419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.356652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.356928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.357201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.357309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81819) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 07 12:57:51.357533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.357618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.357808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.357899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.358076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.358169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.358874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.358996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.359201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.359286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.359474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.359636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.359773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81818) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.359904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.360067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.360368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.360765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.361040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.361309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.361620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81819) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 07 12:57:51.394570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559efe0359c0 pid: 81818 (default app) Sep 07 12:57:51.396704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559efe0359c0 pid: 81819 (default app) Sep 07 12:57:51.397949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3b31-e60a-4cd9-aaf0-7e88728618e9 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:51.398232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3b31-e60a-4cd9-aaf0-7e88728618e9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:51.398501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f3b31-e60a-4cd9-aaf0-7e88728618e9 None None] PATH_INFO: `/v3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:51.402654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Wed Sep 7 12:57:51 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:57:59.060002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:59.060506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:59.060506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:59.065398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:57:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:57:59.070874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:57:59.071290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:57:59.071406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:57:59.141839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: INFO dbcounter [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] Registered counter for database keystone Sep 07 12:57:59.161203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG oslo_db.sqlalchemy.engines [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81818) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:57:59.167507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writer thread running {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:57:59.360515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG passlib.handlers.bcrypt [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81818) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 12:57:59.360515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG passlib.handlers.bcrypt [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81818) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 12:57:59.405530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:57:59.407125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:57:59.541088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:57:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 07 12:58:00.051126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:00.120926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: INFO dbcounter [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] Registered counter for database keystone Sep 07 12:58:00.143708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG oslo_db.sqlalchemy.engines [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81819) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 12:58:00.149980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writer thread running {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 12:58:00.271447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fcd84-3490-46ff-98cb-f3febe2d8130 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:00.275741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:00.276402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:00.276684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:00.276955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:00.285784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:00.336398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING keystone.common.rbac_enforcer.enforcer [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 12:58:00.336677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04157bc6-711e-482d-93b0-5d63d10fe9fc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:00.346864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Sep 7 12:58:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 12:58:00.352957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:00.366954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fae15c-c9b2-45e7-9e34-d387c40662dd None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:00.371302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:00.372610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:00.372887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:00.373155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] PATH_INFO: `/v3/projects/07da914e24704120962aa1acd6dda617` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:00.374712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] RBAC: Authorizing `identity:get_project(project_id=07da914e24704120962aa1acd6dda617)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:00.427402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 07 12:58:00.427737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36528421-808f-4f3f-a6fa-0a66ab4d32bd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:00.432291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Wed Sep 7 12:58:00 2022] GET /identity/v3/projects/07da914e24704120962aa1acd6dda617 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:02.567980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2e54-bbf9-4120-914b-01aedd84cf30 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.568528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2e54-bbf9-4120-914b-01aedd84cf30 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.568528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e2e54-bbf9-4120-914b-01aedd84cf30 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.572638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:02.577987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.578392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.578541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.598338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:02.599854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:02.607632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 07 12:58:02.885588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2e54-bbf9-4120-914b-01aedd84cf30 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:02.897870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e2e54-bbf9-4120-914b-01aedd84cf30 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:02.902060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31aca8-9510-4676-b2ba-50d55186d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:02.902665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aca8-9510-4676-b2ba-50d55186d708 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.902943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aca8-9510-4676-b2ba-50d55186d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.903212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31aca8-9510-4676-b2ba-50d55186d708 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.911257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aca8-9510-4676-b2ba-50d55186d708 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:02.913059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31aca8-9510-4676-b2ba-50d55186d708 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:02.922288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Wed Sep 7 12:58:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 12:58:02.927500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:02.936433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ad8ab-8215-4adb-973f-6baa99d95eb6 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:02.940676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cf2d0-6fb9-46a2-b925-118d67543853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:02.941290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cf2d0-6fb9-46a2-b925-118d67543853 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:02.941564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cf2d0-6fb9-46a2-b925-118d67543853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:02.941832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cf2d0-6fb9-46a2-b925-118d67543853 admin admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:02.943124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cf2d0-6fb9-46a2-b925-118d67543853 admin admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:02.944978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cf2d0-6fb9-46a2-b925-118d67543853 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:02.946486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Wed Sep 7 12:58:02 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:05.159097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e030-15a5-4976-813b-a70eb1c2b828 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.159712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e030-15a5-4976-813b-a70eb1c2b828 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.159712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e030-15a5-4976-813b-a70eb1c2b828 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.161024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:05.166192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1805-a57d-4381-986a-e516612bd424 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.166643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1805-a57d-4381-986a-e516612bd424 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.166738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a1805-a57d-4381-986a-e516612bd424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.184439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-770a1805-a57d-4381-986a-e516612bd424 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:05.185606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-770a1805-a57d-4381-986a-e516612bd424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:05.193820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19791dca-98f4-417b-b1aa-5a1b77968233 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.194099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19791dca-98f4-417b-b1aa-5a1b77968233 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.194369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19791dca-98f4-417b-b1aa-5a1b77968233 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.195712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:05.200922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.201206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.201480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.243701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG passlib.handlers.bcrypt [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81819) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 07 12:58:05.244100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG passlib.handlers.bcrypt [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81819) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 07 12:58:05.268578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:05.293736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:05.295370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:05.394892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:05.549802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1805-a57d-4381-986a-e516612bd424 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:05.575063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:05.654174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a1805-a57d-4381-986a-e516612bd424 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:05.669633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:05.690841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:05.691485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.691768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.692045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.703090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:05.711911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:05.713059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:05.713912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:05.719074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:05.771292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecb286-aebd-43ce-99f1-46b1b9715d36 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:05.773627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:05.800902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:05.808395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:05.809263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.809540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.809833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.819582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece953c-facc-46db-b02f-3e37037be822 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:05.852882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:05.853485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:05.853766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:05.854065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:05.854798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:05.855104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:05.856547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:05.868651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:05.874933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:05.880274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:05.881987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:05.973401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886357c2-ece2-4d10-a742-a801e4d136ef None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:05.978864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:05.984618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:05.987575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.009260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.009901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.010176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.010445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.011580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:06.013117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:06.015332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:05 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:06.021315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:06.036059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.086174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98826fa6-5177-4277-bfd2-0ddb4afa6107 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:06.119116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93308f46-90ab-4750-827e-ae648204c04c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:06.120302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.121220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.121520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.121792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.140215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:06.141885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:06.152414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.153043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.153322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.153594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.155227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:06.156728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:06.158296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:06.160917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:06.162153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:06.162945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:06.162945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:06.162945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:06.162945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:06.164258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:06.168740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:06.224292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.245697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:06.265215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19343221-b173-45da-a030-95e9b67f3fb6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:06.270903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e0484-4071-4146-ac83-6142dea485c4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:06.298729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.299335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.299612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.299891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.300693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.domain.id=default, user.id=4baafbf2b11a43589e472cfef377adf4) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:06.300987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:06.302433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956496b7-7116-4e76-ad64-9194eb46d1bc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:06.304514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:06.305169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:06.305447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:06.305714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:06.306354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:06.306650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:06.308003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cd252-5c74-46fa-8dd1-f247151555e8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:06.309055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1322 bytes} [Wed Sep 7 12:58:06 2022] GET /identity/v3/role_assignments?user.id=4baafbf2b11a43589e472cfef377adf4&scope.domain.id=default&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:06.327950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:08.831316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30831f-1175-448e-b766-53048c9e1c03 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:08.831816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30831f-1175-448e-b766-53048c9e1c03 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:08.831886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30831f-1175-448e-b766-53048c9e1c03 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:08.833242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:08.846982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f436777-527c-4bc1-9227-f9b93f9de057 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:08.847863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f436777-527c-4bc1-9227-f9b93f9de057 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:08.848386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f436777-527c-4bc1-9227-f9b93f9de057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:08.872744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1f436777-527c-4bc1-9227-f9b93f9de057 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:08.874434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1f436777-527c-4bc1-9227-f9b93f9de057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:08.973594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:09.046077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae84a3-d5e5-431e-b46c-664cfea7ba5e None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.046713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae84a3-d5e5-431e-b46c-664cfea7ba5e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.047184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae84a3-d5e5-431e-b46c-664cfea7ba5e None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.048798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:09.054333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.054853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.055327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.080557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:09.082118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:09.092667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96321a1-22a9-4e96-9857-decf91c1ae48 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.093255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96321a1-22a9-4e96-9857-decf91c1ae48 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.093727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96321a1-22a9-4e96-9857-decf91c1ae48 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.095277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 14/25] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:09.100573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.101098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.101578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.133789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:09.136133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:09.200719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:09.262841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 12/26] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:09.293792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 15/27] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:09.321962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:09.441814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5a3f7-a1a5-45b1-acd5-929cfb681e7e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:09.479635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa113c-bdf1-40bd-a1d2-2aa6cc87aa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:09.480314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa113c-bdf1-40bd-a1d2-2aa6cc87aa36 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.480596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa113c-bdf1-40bd-a1d2-2aa6cc87aa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.480875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa113c-bdf1-40bd-a1d2-2aa6cc87aa36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.496002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa113c-bdf1-40bd-a1d2-2aa6cc87aa36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-74aa113c-bdf1-40bd-a1d2-2aa6cc87aa36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:09.503651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:09.504538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:09.505280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 13/28] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:09.512194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:09.616393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:09.644076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d39fb03-69bd-46a9-a084-9cdbf41a3157 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:09.668748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b14d-7825-4f86-8cbd-57d29d9ca9ce None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.669292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b14d-7825-4f86-8cbd-57d29d9ca9ce None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.669770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487b14d-7825-4f86-8cbd-57d29d9ca9ce None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.671725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 14/29] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:09.676617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.677146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.677617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.699499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:09.700139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.700419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.700689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.701357 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:09.701722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:09.703296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:09.712139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:09.712858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 16/30] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:09.713920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:09.714117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:09.766328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:09.837972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 15/31] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:09.839170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:09.903206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af4d88-f7de-4abd-854f-bd01e3b3387e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:09.963488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:09.964150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:09.964440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:09.964715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:09.971010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:09.990683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:09.994316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.011597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33718818-703f-4fbc-9dd5-47ccf05ebf6e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:58:10.024658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:10.025506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:58:10.026323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:58:10.026323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:58:10.026323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:10.026323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 17/32] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:10.027173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:10.069244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:10.069903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.070231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.070509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.072805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:10.076456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.078248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 16/33] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:09 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:10.078850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:10.160653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:10.205646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef9d5-5aaf-443e-9013-8c341c9207a3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.240077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee00689-2780-4b46-b544-51ef86cbe5af None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.252620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:10.253862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.254435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.254866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.255870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:10.258113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.279311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:10.280049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.280437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.280836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.281600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:10.282009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:10.283517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.296340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 17/34] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:10.296953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:10.395925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:10.402799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192492e8-5ece-4c1d-83af-68ea19865d56 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.437194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:10.437991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.438309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.438747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.440205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:10.441644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.448071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 18/35] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:10.448071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:10.457127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 18/36] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 7 12:58:10 2022] POST /identity/v3/roles => generated 225 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:10.457959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:10.521543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:10.580043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217bf0e-608a-4979-8727-da26b1b9de9f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.596631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202b6e-b28f-479f-b1d7-61d4f84dc2e5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.620899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b9b96-f648-4cd5-be4a-e1072c73c24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:10.621628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9b96-f648-4cd5-be4a-e1072c73c24d None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.622017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9b96-f648-4cd5-be4a-e1072c73c24d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.622452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b9b96-f648-4cd5-be4a-e1072c73c24d None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.623188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9b96-f648-4cd5-be4a-e1072c73c24d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:10.625981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b9b96-f648-4cd5-be4a-e1072c73c24d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.642459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a360b-4037-49d5-b0aa-a69db26c551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:10.643762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a360b-4037-49d5-b0aa-a69db26c551c None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.644327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a360b-4037-49d5-b0aa-a69db26c551c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.644797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a360b-4037-49d5-b0aa-a69db26c551c None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.645681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a360b-4037-49d5-b0aa-a69db26c551c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:10.647578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a360b-4037-49d5-b0aa-a69db26c551c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:10.743133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 12:58:10 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:10.744404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f74fd-003e-42d8-a013-ac5a7bad6390 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.744693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f74fd-003e-42d8-a013-ac5a7bad6390 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.744964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f74fd-003e-42d8-a013-ac5a7bad6390 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.746346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 20/38] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:10.746878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f74fd-003e-42d8-a013-ac5a7bad6390 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:10.860122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:10.864539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f74fd-003e-42d8-a013-ac5a7bad6390 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:10.884065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 7 12:58:10 2022] POST /identity/v3/roles => generated 219 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:10.884065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9310df0-b46a-4d2a-8633-99e109474ca8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:10.884065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9310df0-b46a-4d2a-8633-99e109474ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:10.884065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9310df0-b46a-4d2a-8633-99e109474ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:10.908923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e9310df0-b46a-4d2a-8633-99e109474ca8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:10.910878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e9310df0-b46a-4d2a-8633-99e109474ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:10.943668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:11.017643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 20/40] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:11.020076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f18b12-16ba-4593-b2a9-f2dffabd0bca None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.020465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f18b12-16ba-4593-b2a9-f2dffabd0bca None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.020746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f18b12-16ba-4593-b2a9-f2dffabd0bca None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.022156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 21/41] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:11.028319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.028898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.029337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.033135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.033916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.034426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.034716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] PATH_INFO: `/v3/domains/default/users/4baafbf2b11a43589e472cfef377adf4/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.036961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4baafbf2b11a43589e472cfef377adf4, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.038567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.052881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:11.054135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:11.129185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 22/42] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:11.137530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 21/43] 10.222.0.57 () {58 vars in 1361 bytes} [Wed Sep 7 12:58:10 2022] PUT /identity/v3/domains/default/users/4baafbf2b11a43589e472cfef377adf4/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:11.292407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.379343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:11.396448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.399253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abc201-45c7-46f0-bcb7-a6ab5e4ee8e6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.434636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.435256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.435531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.435804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.437133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.438639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.497288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe79f-27ea-4772-9dd9-682920d40571 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.508326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 7 12:58:11 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:11.538263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323cea3-dcd3-4133-b7ec-48557594fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.538920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cea3-dcd3-4133-b7ec-48557594fa63 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.539258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cea3-dcd3-4133-b7ec-48557594fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.539527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323cea3-dcd3-4133-b7ec-48557594fa63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.540813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cea3-dcd3-4133-b7ec-48557594fa63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.542329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323cea3-dcd3-4133-b7ec-48557594fa63 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.544306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 22/45] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:11.550502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:11.774265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0de8-38b4-41fa-948e-78cea01668a6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:11.807186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc577571-6713-4a1b-ac58-3b99f5e12a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:11.807736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc577571-6713-4a1b-ac58-3b99f5e12a04 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:11.808014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc577571-6713-4a1b-ac58-3b99f5e12a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:11.808317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc577571-6713-4a1b-ac58-3b99f5e12a04 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:11.808958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc577571-6713-4a1b-ac58-3b99f5e12a04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:11.810405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc577571-6713-4a1b-ac58-3b99f5e12a04 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:11.825158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:11.912630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 12:58:11 2022] POST /identity/v3/projects => generated 312 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:13.338151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab08a-c6bc-4290-9d38-d9a756e7b99c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:13.338670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab08a-c6bc-4290-9d38-d9a756e7b99c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:13.338752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab08a-c6bc-4290-9d38-d9a756e7b99c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:13.340062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 23/47] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:13.345423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:13.345840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:13.345982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:13.364199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:13.365395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:13.432012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:13.700361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab08a-c6bc-4290-9d38-d9a756e7b99c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:13.728922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:13.813225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab08a-c6bc-4290-9d38-d9a756e7b99c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:13.846613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:13.847245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:13.847603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:13.847881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:13.857848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:13.863107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:13.864110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:13.865072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 24/49] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:13.870105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:13.971806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e900ae3-0b68-4e3c-882d-e4ab440ba903 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:13.995118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:14.005802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:14.007905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.007905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.007905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.007905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:14.008207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:14.009438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918921d-0f21-468d-ad42-fe99eb24c982 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:14.021909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 26/50] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:14.027669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:14.064649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6ac3d-03f3-4867-86f8-ed3323a1bffd None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.064930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6ac3d-03f3-4867-86f8-ed3323a1bffd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.065202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6ac3d-03f3-4867-86f8-ed3323a1bffd None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.066591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 27/51] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:14.071648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.071933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.072242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.091155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:14.092970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:14.121808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:14.134618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab551-f247-46c5-995f-b275a73b64c5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:14.161240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 28/52] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:14.170658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:14.171289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.171563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.171833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.172980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:14.174437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:14.176000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 25/53] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:14 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:14.181437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:14.277179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8cce16-bba2-4f84-a2f4-1b46526a4a22 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:14.292824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:14.309787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:14.310421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.310698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.311629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.312747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:14.314203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:14.315760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 29/54] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:14.321715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:14.418857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d56964-29d2-49f1-a644-c2fe49d8f181 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:14.430524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:14.454322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:14.454928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.455209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.455482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.456241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.domain.id=default, user.id=4baafbf2b11a43589e472cfef377adf4) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:14.456548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:14.457999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:14.463764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 26/55] 10.222.0.57 () {56 vars in 1322 bytes} [Wed Sep 7 12:58:14 2022] GET /identity/v3/role_assignments?user.id=4baafbf2b11a43589e472cfef377adf4&scope.domain.id=default&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:14.538835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877ec95-d07c-44af-b8d7-24fcd5a812e2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:14.577275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f535aac-baa3-47ca-8884-903d2a59e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:14.577928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535aac-baa3-47ca-8884-903d2a59e577 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.578204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535aac-baa3-47ca-8884-903d2a59e577 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.578475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f535aac-baa3-47ca-8884-903d2a59e577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.579611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535aac-baa3-47ca-8884-903d2a59e577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:14.581109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f535aac-baa3-47ca-8884-903d2a59e577 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:14.582717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 30/56] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:14.588695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:14.612744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:14.695741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f1883-2874-4f88-967b-96876183c891 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:14.728806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c48e28-fd5c-4816-9236-9d11ae693fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:14.729404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c48e28-fd5c-4816-9236-9d11ae693fd6 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:14.729679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c48e28-fd5c-4816-9236-9d11ae693fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:14.729946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c48e28-fd5c-4816-9236-9d11ae693fd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:14.730598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c48e28-fd5c-4816-9236-9d11ae693fd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:14.732035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c48e28-fd5c-4816-9236-9d11ae693fd6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:14.827941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 27/57] 10.222.0.57 () {60 vars in 1140 bytes} [Wed Sep 7 12:58:14 2022] POST /identity/v3/projects => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:16.985259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff8d7-5d1f-42f4-8790-ff91905626ca None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:16.985757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff8d7-5d1f-42f4-8790-ff91905626ca None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:16.985757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff8d7-5d1f-42f4-8790-ff91905626ca None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:16.987102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 31/58] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:16.992230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:16.992626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:16.992794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:17.011578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:17.013124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:17.084701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 28/59] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:17.350964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ff8d7-5d1f-42f4-8790-ff91905626ca None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:17.403111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:17.450210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ff8d7-5d1f-42f4-8790-ff91905626ca None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:17.482548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da599e7b-df1a-471f-a2b5-1fcaf33dc481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:17.483759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da599e7b-df1a-471f-a2b5-1fcaf33dc481 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:17.484032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da599e7b-df1a-471f-a2b5-1fcaf33dc481 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:17.484328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da599e7b-df1a-471f-a2b5-1fcaf33dc481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:17.485436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da599e7b-df1a-471f-a2b5-1fcaf33dc481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:17.486874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da599e7b-df1a-471f-a2b5-1fcaf33dc481 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:17.488472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 32/60] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:17.494125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:17.496323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:17.591533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f603d38-1a11-4f5a-aa83-ff256a0cbe1a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:17.625028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6383063-cef8-41a5-8915-ee02fc33d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:17.625631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6383063-cef8-41a5-8915-ee02fc33d5d4 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:17.625913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6383063-cef8-41a5-8915-ee02fc33d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:17.626183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6383063-cef8-41a5-8915-ee02fc33d5d4 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:17.626839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6383063-cef8-41a5-8915-ee02fc33d5d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:17.628328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6383063-cef8-41a5-8915-ee02fc33d5d4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:17.815319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 29/61] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:17 2022] POST /identity/v3/users => generated 275 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:20.982930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735daa79-ed22-49d9-ab7f-3f0ce24aaddc None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:20.983898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735daa79-ed22-49d9-ab7f-3f0ce24aaddc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:20.984347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735daa79-ed22-49d9-ab7f-3f0ce24aaddc None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:20.985921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 33/62] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:20.991331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975ee2f-ed6c-4dba-9220-bb10d3fe81f4 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:20.992250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975ee2f-ed6c-4dba-9220-bb10d3fe81f4 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:20.992734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975ee2f-ed6c-4dba-9220-bb10d3fe81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.012783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d975ee2f-ed6c-4dba-9220-bb10d3fe81f4 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:21.014874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d975ee2f-ed6c-4dba-9220-bb10d3fe81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.071290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:21.085772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 30/63] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:21.351328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735daa79-ed22-49d9-ab7f-3f0ce24aaddc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:21.418322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960f3e-3fb6-4857-bb24-af25839aa260 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.418935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960f3e-3fb6-4857-bb24-af25839aa260 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.419416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50960f3e-3fb6-4857-bb24-af25839aa260 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.421537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 31/64] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:21.426838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106a784-6d5c-4011-afd2-da343b2f4357 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.427454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106a784-6d5c-4011-afd2-da343b2f4357 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.427920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106a784-6d5c-4011-afd2-da343b2f4357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.451977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9106a784-6d5c-4011-afd2-da343b2f4357 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:21.453600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9106a784-6d5c-4011-afd2-da343b2f4357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.490336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735daa79-ed22-49d9-ab7f-3f0ce24aaddc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:21.516827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:21.524747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 32/65] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:21.526352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed5d1b-c1d6-4810-94b4-eb923dac5fc3 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.526836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed5d1b-c1d6-4810-94b4-eb923dac5fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.527280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed5d1b-c1d6-4810-94b4-eb923dac5fc3 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.529052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 33/66] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:21.532695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:21.533556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.533556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.533875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.535767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52100d-990a-497c-a3ab-e37477337ef2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.536297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52100d-990a-497c-a3ab-e37477337ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.536765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52100d-990a-497c-a3ab-e37477337ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.552814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:21.563719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:21.564673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:21.565456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:21.568444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 34/67] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:21.575033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:21.576142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1e52100d-990a-497c-a3ab-e37477337ef2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:21.580336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1e52100d-990a-497c-a3ab-e37477337ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.696019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 34/68] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:21.706103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045958b-fb89-49de-8f1a-1b96d54b880d None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.706388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045958b-fb89-49de-8f1a-1b96d54b880d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.706663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045958b-fb89-49de-8f1a-1b96d54b880d None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.708011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 35/69] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:21.718043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182573-9467-4088-ad67-e3899978c67b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.718321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182573-9467-4088-ad67-e3899978c67b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.718596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33182573-9467-4088-ad67-e3899978c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.749863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-33182573-9467-4088-ad67-e3899978c67b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:21.751102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-33182573-9467-4088-ad67-e3899978c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:21.761099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b289-8034-4f94-ac02-9cef2046afa1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:21.822505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:21.823132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:21.823415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:21.823684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:21.824387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:21.824691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:21.826080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:21.841363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 35/70] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:21.848308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:21.848438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:21.882601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 36/71] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:21.883372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33182573-9467-4088-ad67-e3899978c67b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:21.910223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:21.972861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239cf6c-1f77-4261-be48-6308a4dc10ac None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.011099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14c0e0-99f7-48cf-b3db-03bfa6d19028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.011795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14c0e0-99f7-48cf-b3db-03bfa6d19028 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.012187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14c0e0-99f7-48cf-b3db-03bfa6d19028 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.012308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33182573-9467-4088-ad67-e3899978c67b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.012682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14c0e0-99f7-48cf-b3db-03bfa6d19028 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.028535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14c0e0-99f7-48cf-b3db-03bfa6d19028 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.030040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14c0e0-99f7-48cf-b3db-03bfa6d19028 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.031708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 36/72] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:21 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.032903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d3e5-6228-4f74-96ce-73c2a27b09f3 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.033185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d3e5-6228-4f74-96ce-73c2a27b09f3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.033468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d3e5-6228-4f74-96ce-73c2a27b09f3 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.034835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 37/73] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:22.035381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d3e5-6228-4f74-96ce-73c2a27b09f3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.054275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.055013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.055364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.055709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.066893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:22.071850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:22.072861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 37/74] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:22.073799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.120801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.147364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.151967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d3e5-6228-4f74-96ce-73c2a27b09f3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.184447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a42cd4-047d-433b-8c3c-1e067e06e604 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.186130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17372-95b2-4d4c-9a1a-6ac4c0e3e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.187319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17372-95b2-4d4c-9a1a-6ac4c0e3e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.187600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17372-95b2-4d4c-9a1a-6ac4c0e3e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.187891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17372-95b2-4d4c-9a1a-6ac4c0e3e2d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.199450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17372-95b2-4d4c-9a1a-6ac4c0e3e2d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-78a17372-95b2-4d4c-9a1a-6ac4c0e3e2d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:22.204374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:22.205251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:22.206015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 38/75] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:22.210982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.211281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.211663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.221405 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.222110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.222387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.222659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.232298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:22.233978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:22.290149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.291641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.299548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 39/76] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:22.316206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.347951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.392357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.401932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b2b48-02e9-4cdc-a6b6-e59d065acae0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.417747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 38/77] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:22.417747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.442703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.443311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.443649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.443921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.444616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:22.444910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.446278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.455008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 40/78] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.455646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.525286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830cb192-5c2c-4703-b9f1-44deef3b862c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.561714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.562376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.562662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.562939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.564027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470a46e-ae63-4a05-92f9-57ea453d6100 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.570752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.575289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:22.580445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:22.583858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 39/79] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:22.584659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.600210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.600828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.601145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.601424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.602093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:22.602396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.603770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.612197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 41/80] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.612988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.628162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.685707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c2666-e2d9-45b1-99c5-decff2d3269a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.713867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578b76-5596-42e7-86a9-7f219d4107ea None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.719760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.720419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.720691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.720957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.722478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.724401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.726350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 40/81] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.727113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.749884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.750524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.750802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.751075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.752261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.753711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.755306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 42/82] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.756168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.791947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.824903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449b2d-83e7-4048-bebc-91c126d1935e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.838343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:22.856636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b664e6-15e5-494a-864a-1824bb74414e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:22.859632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.860279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.860556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.860821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.861925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.863406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.865203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 41/83] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.865770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.890769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:22.891634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:22.891909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:22.892234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:22.892877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:22.893178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:22.894534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:22.902694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 43/84] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:22.903489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:22.967675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00023820-5225-48f7-bb41-eb9c04d9e894 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.001669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.002288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.002562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.002830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.003127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a6a4-753c-40ab-b2f4-3dd05b3a6053 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.003943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.005425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.007151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 42/85] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:23.007749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.010247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.038013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.038635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.038914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.039188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.039917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=0288e290a4f449a08f479aef090aafb0) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:23.040250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.041706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.050907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 44/86] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:22 2022] GET /identity/v3/role_assignments?user.id=0288e290a4f449a08f479aef090aafb0&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:23.051636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.064159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.131283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba9cbd-dfc0-499b-bed2-772f726fe969 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.168605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbea96-0770-478f-a919-e41b88fe2dcb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.172539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.172729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.172985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.173258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.208869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.209517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.209799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.210069 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.210896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.213091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.247702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.253623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.253623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.307213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 45/87] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:23 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:23.308482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.379172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 43/88] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:23.380510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.411789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.468605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372907a5-da7b-4285-9e08-b0b437f3c45a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.519192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.519384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39645c-2b27-48a7-9c9b-c0f91b8b66ea None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.520321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.520858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.521369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.522205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.522977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.524428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.526123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 46/89] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:23 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:23.526922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.611432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.611984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.612394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.612674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.658182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea0d7a-3555-4466-8a47-c771481c429f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.698182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.705131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.706143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.706428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.707118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.708618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.710361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.713719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 47/90] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:23 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:23.713902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.720808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.722314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.844120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c4c8-170a-46b2-8379-43c96f5dd92d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:23.848377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 44/91] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:23.849366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:23.851753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.881264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:23.881890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:23.882169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:23.882442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:23.953494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:23.956137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:23.957651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:23.962347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10096ee8-5d4e-4065-87a3-a06d41bcfb7d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:24.001816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:24.002452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.002765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.003120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.003879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=4baafbf2b11a43589e472cfef377adf4) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:24.004226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:24.005932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:24.012824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 45/92] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:23 2022] GET /identity/v3/role_assignments?user.id=4baafbf2b11a43589e472cfef377adf4&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:24.013619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:24.069275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 48/93] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:24.083374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:24.097286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:24.139455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6f485-5e76-4cc6-8495-7badbf476959 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:24.179049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:24.180029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.180525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.181003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.182338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:24.183949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:24.186509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 46/94] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:24 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:24.193619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:24.277263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:24.281262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f30d2-624c-4baf-a851-f3cdefcadcb8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:24.309684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc07513-9932-4a09-b7be-58112b8f0590 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:24.348355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:24.349254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.349738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.350156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.351095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] RBAC: Adding query filter params (role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=0288e290a4f449a08f479aef090aafb0) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:24.351564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:24.353206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:24.355492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:24.360874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 47/95] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:24 2022] GET /identity/v3/role_assignments?user.id=0288e290a4f449a08f479aef090aafb0&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:24.376624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aba4f7-c734-4687-afb5-ad7ee7294f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:24.377275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aba4f7-c734-4687-afb5-ad7ee7294f30 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.377589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aba4f7-c734-4687-afb5-ad7ee7294f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.377820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aba4f7-c734-4687-afb5-ad7ee7294f30 None admin] PATH_INFO: `/v3/projects/df36f27d5ef049118aa03615aeb25da7` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.378958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aba4f7-c734-4687-afb5-ad7ee7294f30 None admin] RBAC: Authorizing `identity:get_project(project_id=df36f27d5ef049118aa03615aeb25da7)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:24.380466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aba4f7-c734-4687-afb5-ad7ee7294f30 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:24.382233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 49/96] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:24 2022] GET /identity/v3/projects/df36f27d5ef049118aa03615aeb25da7 => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:24.389778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:24.512046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b463136-e97a-4712-b9e0-06aff49e73b8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:24.557639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:24.558262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:24.558537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:24.558807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:24.559609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=df36f27d5ef049118aa03615aeb25da7, user.id=0288e290a4f449a08f479aef090aafb0) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:24.559919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:24.561576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ebe11-6cb0-4a22-af04-bc9428d9d598 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:24.567821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 48/97] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:24 2022] GET /identity/v3/role_assignments?user.id=0288e290a4f449a08f479aef090aafb0&scope.project.id=df36f27d5ef049118aa03615aeb25da7&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:25.555084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a3012-fccb-4f0e-a9d0-15dc957ef610 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:25.555599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a3012-fccb-4f0e-a9d0-15dc957ef610 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:25.555894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a3012-fccb-4f0e-a9d0-15dc957ef610 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:25.557411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 50/98] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:25.563508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:25.563999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:25.564274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:25.593173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:25.594380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:25.668151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:25.686954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 49/99] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:26.237316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a3012-fccb-4f0e-a9d0-15dc957ef610 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:26.383987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a3012-fccb-4f0e-a9d0-15dc957ef610 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:26.430002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8cca0-830c-42d8-8d55-50af415543a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:26.430648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8cca0-830c-42d8-8d55-50af415543a7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.430926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8cca0-830c-42d8-8d55-50af415543a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.431197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8cca0-830c-42d8-8d55-50af415543a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.446411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8cca0-830c-42d8-8d55-50af415543a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8af8cca0-830c-42d8-8d55-50af415543a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:26.451355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:26.452216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:26.452972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 51/100] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:26.459795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:26.529376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b411-f7d7-4d70-96b5-6e1065c91b62 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.529635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b411-f7d7-4d70-96b5-6e1065c91b62 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.529957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94b411-f7d7-4d70-96b5-6e1065c91b62 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.531349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 52/101] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:26.544759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6bfb0-85a0-4a6f-9670-aeff5d2c1854 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.545064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6bfb0-85a0-4a6f-9670-aeff5d2c1854 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.545977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6bfb0-85a0-4a6f-9670-aeff5d2c1854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.574179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7da6bfb0-85a0-4a6f-9670-aeff5d2c1854 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:26.575407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7da6bfb0-85a0-4a6f-9670-aeff5d2c1854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:26.621161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:26.667800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bba02-e6d7-4598-b681-0b0ce0f03dd5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:26.691372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 53/102] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:26.692927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509b53-e6bd-4757-8a93-d5162ac3bde4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.692927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509b53-e6bd-4757-8a93-d5162ac3bde4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.693200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49509b53-e6bd-4757-8a93-d5162ac3bde4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.694595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 54/103] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:26.699809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.700125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.700400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.728891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:26.729511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.729788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.730064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.730735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:26.731038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:26.732457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:26.735033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:26.736280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:26.752846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 50/104] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:26.759778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:26.857695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:26.867603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 55/105] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:26.940340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098744-4eae-4333-ba3d-1d140c89a7b6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:26.982168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:26.983374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:26.983659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:26.983934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:26.985128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:26.986601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:26.988212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 51/106] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:26 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:26.993974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:27.038784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:27.190316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:27.229305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd9911-60de-491c-a8dd-eeeed9c53e52 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:27.281373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd7f80-c275-4c6b-bd2f-4dd97dd48ec5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:27.314348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:27.327063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:27.327803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.328198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.328471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.333712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:27.334368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.334649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.334922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.339901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:27.340797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:27.342871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:27.344947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 56/107] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:26 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:27.345720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:27.345990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:27.346799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:27.347578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 52/108] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:27.352818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:27.466278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c239899-61f0-4053-afa1-2db106c90d5d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:27.508946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:27.510019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.510295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.510613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/0288e290a4f449a08f479aef090aafb0/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.512683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1f6ffbba488ba6e3432cd797be36, user_id=0288e290a4f449a08f479aef090aafb0, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:27.514983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:27.564691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f40971-2deb-4f41-b700-3b3405ec4622 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:27.601333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:27.602008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.602240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.602513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.603669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:27.605160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:27.607064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 57/109] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:27.612986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:27.635239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 53/110] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:27 2022] PUT /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/0288e290a4f449a08f479aef090aafb0/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:27.636104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:27.650080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:27.724925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:27.725452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d133a-9a1b-490d-8b64-09ee213b7a75 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:27.763622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:27.764299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.764586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.764871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.765568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:27.765877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:27.767562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11425-8c47-475a-b486-1de85abe328d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:27.777482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 58/111] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:27.778909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf751-7198-4bd0-bdae-499999e5bcaf None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.779202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf751-7198-4bd0-bdae-499999e5bcaf None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.780012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6accf751-7198-4bd0-bdae-499999e5bcaf None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.781540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 59/112] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:27.782436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06050e-17d0-41aa-8157-b894ab0b16af None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.782794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06050e-17d0-41aa-8157-b894ab0b16af None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.783074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06050e-17d0-41aa-8157-b894ab0b16af None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.784509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 60/113] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:27.791940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd798-d163-45dd-927e-04f0c1542968 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.792366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd798-d163-45dd-927e-04f0c1542968 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.792981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dd798-d163-45dd-927e-04f0c1542968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.812935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55b2e-9424-403f-86ec-e8d75fe6ef7a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:27.815335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6a6dd798-d163-45dd-927e-04f0c1542968 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:27.816717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6a6dd798-d163-45dd-927e-04f0c1542968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:27.852476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e72194-320a-441c-839d-471affedbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:27.853096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e72194-320a-441c-839d-471affedbca7 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.853456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e72194-320a-441c-839d-471affedbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.853748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e72194-320a-441c-839d-471affedbca7 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.854588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e72194-320a-441c-839d-471affedbca7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:27.856010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e72194-320a-441c-839d-471affedbca7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:27.900007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 61/114] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:27.901123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ed47-6c06-42ff-b7b4-5f2503f0f93c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:27.901403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ed47-6c06-42ff-b7b4-5f2503f0f93c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:27.901673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ed47-6c06-42ff-b7b4-5f2503f0f93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:27.921360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-df38ed47-6c06-42ff-b7b4-5f2503f0f93c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:27.922699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-df38ed47-6c06-42ff-b7b4-5f2503f0f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:27.950886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:27.966391 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 54/115] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 12:58:27 2022] POST /identity/v3/projects => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:27.968553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e72194-320a-441c-839d-471affedbca7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.051843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 62/116] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:28.094424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df434-f1fa-48a0-9178-8f2de5f95087 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.095054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df434-f1fa-48a0-9178-8f2de5f95087 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.095579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711df434-f1fa-48a0-9178-8f2de5f95087 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.097285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 63/117] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:28.109795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.110399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.110893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.126700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:28.136112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e72194-320a-441c-839d-471affedbca7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:28.142891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:28.144427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:28.196033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:28.198469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.199020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.199623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] PATH_INFO: `/v3/users/526a900ae1af4ad189f9c704e5386f5f` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.226197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] RBAC: Authorizing `identity:get_user(user_id=526a900ae1af4ad189f9c704e5386f5f)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:28.229533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:28.232365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 55/118] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:27 2022] GET /identity/v3/users/526a900ae1af4ad189f9c704e5386f5f => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:28.234147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.280023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 64/119] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:28.283440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.381707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:28.413063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8f25-7fa7-4bb6-81fc-1c840b652291 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:28.415632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefef42-375b-494c-ad3c-7fbf8fa3a3dc None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:28.458331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:28.458997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.459304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.459689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.466521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:28.468695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.469183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.469656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.485452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:28.492863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:28.493758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:28.494556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:28.496763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 56/120] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:28.497904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.554427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:28.591952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:28.593513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:28.681193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578681e8-b6bc-4e06-9a19-0a6ec287341f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:28.704159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:28.727718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:28.729606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.730339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.730763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.732626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 65/121] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:28.734950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.744823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:28.751266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:28.752132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:28.752915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:28.754088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 57/122] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:28.755429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.855193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:28.872734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee24f0-b3a0-4199-891b-aad6f05a427f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:28.893612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47448889-9c77-4dd8-a8de-384180ec48c9 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:28.917336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:28.917974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.918311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.918671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.919398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:28.919764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:28.922453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:28.936350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 66/123] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:28.937388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.945191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:28.945901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:28.946248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:28.946605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:28.957770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:28.963142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:28.964004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:28.964797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 58/124] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:28.970015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:28.985887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.051906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedadb6-d284-406e-b59c-dd6243aa2eb4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.083792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2a604-c2e8-47c1-9275-25621eb541d6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.089073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.089931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.090390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.090859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.092715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.094458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.096407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 67/125] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.097398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.116195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.121651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.122428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.122846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.123276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.124314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:29.124830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.126343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.135390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 59/126] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.136567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.209275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5331f9-0091-4357-baf1-4892f5f54c4d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.217648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.247710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5169-5fba-4acd-8c91-eb0c67c46347 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.249920 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.250672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.251014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.252108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.252627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.254280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.260418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 68/127] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.261373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.289212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.290027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.290442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.290938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.291866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:29.292385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.294032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.303713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 60/128] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.309345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.370777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc1530-72cf-47f0-b0d9-5fb61c181e19 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.376459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.408291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.410143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.410425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.410700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.411429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] RBAC: Adding query filter params (role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=526a900ae1af4ad189f9c704e5386f5f) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:29.411739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.413401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.419293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 69/129] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/role_assignments?user.id=526a900ae1af4ad189f9c704e5386f5f&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.420280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.426474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b2432-8d4a-422d-87f0-a08536ddccff None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.468422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.469400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.469874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.470396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.472055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.474124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.476097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 61/130] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.477460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.497277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.609026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a288c3-f393-4d16-a4b8-0fb5146e0165 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.654370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.672030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.673125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.673632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.675263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.675924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.677625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.679484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 62/131] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.680550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.698106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b6317-ffe6-4e5b-a0fd-e9604511c5a1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.765379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.769625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.770084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.770541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.772204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.773816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.776922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 70/132] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.779167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.841679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd118f-80b6-4d71-8a7a-f0a9d67cff54 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.882438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:29.883430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:29.883904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:29.884553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:29.886695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:29.888693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:29.890668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 63/133] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:29.892425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:29.963229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:29.986974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993e0f-edb8-4dfc-a031-347c0e4789e6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:29.998824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:30.029089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75972d-e4e9-44da-949d-4fc386dbb2ea None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:30.056969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:30.058019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.058682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.061246 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] PATH_INFO: `/v3/projects/df36f27d5ef049118aa03615aeb25da7` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.063777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] RBAC: Authorizing `identity:get_project(project_id=df36f27d5ef049118aa03615aeb25da7)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:30.067266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:30.067266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 71/134] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:29 2022] GET /identity/v3/projects/df36f27d5ef049118aa03615aeb25da7 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:30.068001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:30.083873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:30.084899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.085353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.085792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/0288e290a4f449a08f479aef090aafb0/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.088372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1f6ffbba488ba6e3432cd797be36, user_id=0288e290a4f449a08f479aef090aafb0, role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:30.090154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:30.183495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be779a-8296-4d73-839b-b56c41798719 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:30.206103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 64/135] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:29 2022] PUT /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/0288e290a4f449a08f479aef090aafb0/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:30.207228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:30.223073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0d07-9cb8-4582-8572-abb64feff7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:30.223747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0d07-9cb8-4582-8572-abb64feff7eb None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.224020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0d07-9cb8-4582-8572-abb64feff7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.224323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0d07-9cb8-4582-8572-abb64feff7eb None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/4baafbf2b11a43589e472cfef377adf4/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.226306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c0d07-9cb8-4582-8572-abb64feff7eb None admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1f6ffbba488ba6e3432cd797be36, user_id=4baafbf2b11a43589e472cfef377adf4, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:30.239303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c0d07-9cb8-4582-8572-abb64feff7eb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:30.319082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 72/136] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:30 2022] PUT /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/4baafbf2b11a43589e472cfef377adf4/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:30.325101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e67c-9f54-4cf5-804d-54923de7f1ed None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.325674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e67c-9f54-4cf5-804d-54923de7f1ed None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.326115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78e67c-9f54-4cf5-804d-54923de7f1ed None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.329001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 73/137] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:30.337529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.338081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.338522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.370059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961026e-b7d3-4b01-bc71-9d5cd86e1bcf None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:30.377236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:30.378819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:30.396135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:30.414259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9a593-d5c1-4422-acb9-5ce25ddcd07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:30.415380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a593-d5c1-4422-acb9-5ce25ddcd07a None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.415806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a593-d5c1-4422-acb9-5ce25ddcd07a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.416292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a593-d5c1-4422-acb9-5ce25ddcd07a None admin] PATH_INFO: `/v3/projects/df36f27d5ef049118aa03615aeb25da7/users/0288e290a4f449a08f479aef090aafb0/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.419120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a593-d5c1-4422-acb9-5ce25ddcd07a None admin] RBAC: Authorizing `identity:create_grant(project_id=df36f27d5ef049118aa03615aeb25da7, user_id=0288e290a4f449a08f479aef090aafb0, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:30.421516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a593-d5c1-4422-acb9-5ce25ddcd07a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:30.436711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:30.494587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 74/138] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:30.527687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 65/139] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:30 2022] PUT /identity/v3/projects/df36f27d5ef049118aa03615aeb25da7/users/0288e290a4f449a08f479aef090aafb0/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:30.846406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:30.855874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e57c8-fe36-4366-a55f-17ac8e39ccd0 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.856806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e57c8-fe36-4366-a55f-17ac8e39ccd0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.857287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e57c8-fe36-4366-a55f-17ac8e39ccd0 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.859231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 66/140] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:30.864907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:30.865524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:30.866002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:30.892345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:30.893902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:30.957955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f406093-e875-4e32-ae22-d74a76a6015e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:31.007452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:31.008114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.010312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.010607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.041425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:31.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:31.053383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:31.054126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 75/141] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:31.057436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 67/142] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:31.065712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:31.097224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:31.179821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0671a9c-96e9-42bb-9d86-ec9c3eefc693 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:31.223667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:31.224220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.224493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.224757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.225422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:31.225716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:31.227315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:31.236820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 76/143] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:31.242634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:31.392939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f92cb-5a12-4774-97fe-f4042a45a4e5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:31.408150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:31.436637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:31.437277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.437561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.437837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.438983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:31.440463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:31.442498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 68/144] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:31 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:31.448028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:31.569159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:31.585062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac20d0d-b861-465d-b94b-787729c7f1db None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:31.629984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:31.630996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.631461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.631918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.666955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:31.704099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:31.705916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:31.835029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:31.860335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 77/145] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:31.866157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:31.922113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f095-bd22-49bc-b183-f91ea4fa26c4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:31.992284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:31.992930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:31.993210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:31.993498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:31.994624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:31.996097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:31.997692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 69/146] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:32.004045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:32.082069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:32.126220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe86e0-740e-4046-8a45-7b7128d3be36 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:32.190280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e973c5f-db3c-4f47-8618-995a45f7ad9e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:32.196845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cb947-887c-4ed2-a8f0-b9dc8985a7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:32.197534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cb947-887c-4ed2-a8f0-b9dc8985a7bb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.197808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cb947-887c-4ed2-a8f0-b9dc8985a7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.198076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cb947-887c-4ed2-a8f0-b9dc8985a7bb None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.203864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cb947-887c-4ed2-a8f0-b9dc8985a7bb None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:32.205350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cb947-887c-4ed2-a8f0-b9dc8985a7bb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:32.209324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 78/147] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:31 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:32.210496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918c987-747e-4bfa-81f5-6e2d2b4d2458 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.210767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918c987-747e-4bfa-81f5-6e2d2b4d2458 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.211029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918c987-747e-4bfa-81f5-6e2d2b4d2458 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.222160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 79/148] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:32.222990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918c987-747e-4bfa-81f5-6e2d2b4d2458 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:32.272820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb44b6-3665-4576-8349-0768a439b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:32.273444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb44b6-3665-4576-8349-0768a439b712 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.273725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb44b6-3665-4576-8349-0768a439b712 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.273996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb44b6-3665-4576-8349-0768a439b712 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.274672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb44b6-3665-4576-8349-0768a439b712 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:32.276147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb44b6-3665-4576-8349-0768a439b712 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:32.313877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:32.362911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918c987-747e-4bfa-81f5-6e2d2b4d2458 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:32.401411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:32.402032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.402302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.402565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.403811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=0288e290a4f449a08f479aef090aafb0) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:32.404143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:32.407551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:32.408038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 70/149] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:32 2022] POST /identity/v3/users => generated 283 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:32.409441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:32.409736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:32.410010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:32.415836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 80/150] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:32 2022] GET /identity/v3/role_assignments?user.id=0288e290a4f449a08f479aef090aafb0&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:32.445992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:32.447246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:32.569180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 71/151] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:32.922440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:33.038888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0392ddc-a645-4df5-bc8d-c7924f8d3f56 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:33.056918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:33.077013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:33.081134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.081134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.081134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.089735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:33.094700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:33.095543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:33.096323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 81/152] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:33.102910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:33.151168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:33.236753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1065a53-dddd-4948-b6b4-405197812125 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:33.281037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:33.281662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.281943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.282223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.282906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:33.283213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:33.284660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:33.296619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 72/153] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:33.302080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:33.414974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01d45a-e0dd-438c-a762-c1ecaa553497 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:33.458418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994aec36-def4-47fc-948e-893e8e2fe159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:33.459080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aec36-def4-47fc-948e-893e8e2fe159 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.459353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aec36-def4-47fc-948e-893e8e2fe159 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.459620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994aec36-def4-47fc-948e-893e8e2fe159 None admin] PATH_INFO: `/v3/users/526a900ae1af4ad189f9c704e5386f5f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.460836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aec36-def4-47fc-948e-893e8e2fe159 None admin] RBAC: Authorizing `identity:get_user(user_id=526a900ae1af4ad189f9c704e5386f5f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:33.462321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994aec36-def4-47fc-948e-893e8e2fe159 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:33.464004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 82/154] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:33 2022] GET /identity/v3/users/526a900ae1af4ad189f9c704e5386f5f => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:33.470049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:33.485655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114e5b-4572-4e9f-bb51-e380d87b290d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.485955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114e5b-4572-4e9f-bb51-e380d87b290d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.486187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a114e5b-4572-4e9f-bb51-e380d87b290d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.487832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 83/155] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:33.493581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eb571-e5d9-491e-8b38-fddfc743cae6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.493854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eb571-e5d9-491e-8b38-fddfc743cae6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.494122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17eb571-e5d9-491e-8b38-fddfc743cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.530508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f17eb571-e5d9-491e-8b38-fddfc743cae6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:33.531765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f17eb571-e5d9-491e-8b38-fddfc743cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:33.587265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:33.625743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 84/156] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:33.627284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc9ac-d496-48ce-9d65-b54bfcbe6c3d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.627573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc9ac-d496-48ce-9d65-b54bfcbe6c3d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.627840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cc9ac-d496-48ce-9d65-b54bfcbe6c3d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.630338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 85/157] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:33.637452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209320cc-b984-4d5b-9358-0a6da8109707 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.637977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209320cc-b984-4d5b-9358-0a6da8109707 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.639381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209320cc-b984-4d5b-9358-0a6da8109707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.663478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:33.667391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-209320cc-b984-4d5b-9358-0a6da8109707 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:33.669075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-209320cc-b984-4d5b-9358-0a6da8109707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:33.682845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f68a-1770-4c2e-a495-1c48d20b162a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:33.725844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f1cc1-1b25-4176-a549-e5a584eab2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:33.726478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f1cc1-1b25-4176-a549-e5a584eab2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.727440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f1cc1-1b25-4176-a549-e5a584eab2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.727732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f1cc1-1b25-4176-a549-e5a584eab2a1 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.728998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f1cc1-1b25-4176-a549-e5a584eab2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:33.730482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f1cc1-1b25-4176-a549-e5a584eab2a1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:33.732174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 73/158] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:33 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:33.733524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0eb6d-37a4-424e-abd4-430ff0a6273e None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.733798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0eb6d-37a4-424e-abd4-430ff0a6273e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.734067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0eb6d-37a4-424e-abd4-430ff0a6273e None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.735345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 74/159] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:33.740650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0eb6d-37a4-424e-abd4-430ff0a6273e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:33.756844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 86/160] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:33.764330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.768488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.768754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.809133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:33.810405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:33.874249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0eb6d-37a4-424e-abd4-430ff0a6273e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:33.950937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:33.952093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:33.953612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:33.954508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/526a900ae1af4ad189f9c704e5386f5f/roles/2bf3a3b90a23411ab1e0539e3ff3e5a8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:33.958696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1f6ffbba488ba6e3432cd797be36, user_id=526a900ae1af4ad189f9c704e5386f5f, role_id=2bf3a3b90a23411ab1e0539e3ff3e5a8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:33.961471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:33.964540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 87/161] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:33.989505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.030050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:34.056568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 75/162] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:33 2022] PUT /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/users/526a900ae1af4ad189f9c704e5386f5f/roles/2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:34.114550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe7345-9197-4925-92fa-7953ececc28d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:34.158189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:34.158851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:34.159127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:34.159399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:34.161750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.173389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:34.178701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:34.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:34.180913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:34.182989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 88/163] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:34.189290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.218199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:34.334364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:34.345791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7977-0266-4f80-98e5-6b85e0e1b85c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:34.352355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337e404-f333-4c57-b03b-a01497d012f3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:34.407553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:34.408221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:34.408502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:34.408767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:34.409447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:34.409747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:34.411137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:34.425760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 89/164] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:34.431747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.461959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:34.462610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:34.462892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:34.463162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:34.501067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:34.506162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:34.507085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:34.507902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 76/165] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:34.516198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.562618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9bee6-ee95-48f2-a252-5823a6a5df51 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:34.603093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:34.603710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:34.603965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:34.604260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] PATH_INFO: `/v3/users/4baafbf2b11a43589e472cfef377adf4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:34.606212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] RBAC: Authorizing `identity:get_user(user_id=4baafbf2b11a43589e472cfef377adf4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:34.607710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:34.609803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 90/166] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/users/4baafbf2b11a43589e472cfef377adf4 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:34.610599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.654002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:34.656166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:34.680530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ae5fc-b1a5-41f0-a0df-8cc11dbacb1b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:34.732070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:34.732809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:34.733088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:34.733359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:34.745923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:34.751388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:34.753869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 77/167] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:34.755965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.838253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f060e-f33c-4101-aec9-bc76871d7edd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:34.911946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:34.912600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:34.912877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:34.913145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:34.913816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:34.914115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:34.915964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:34.935169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 91/168] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:34.935978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:34.953287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb5f36-a02a-4443-bdda-3c8af0e7914b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.024812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.025508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.025791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.026049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.052546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.088462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.105248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4f60f-e7e6-4ede-9460-99f1f9a32fde None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.153105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.155482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.172190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.172190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.172190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.172190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.172564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:35.172564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.173074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.191424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 92/169] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:35.192153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.316677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eefa56-f573-481c-914e-e95802adbbbb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.338599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 78/170] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:35.340072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.352605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.353407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.353780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.354150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.355461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.358990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.358990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 93/171] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:35.359861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.386781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.426048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.475391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5622b4-4000-4933-aa8e-b3f111866e8d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.514688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.515719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.516223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.516942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.518282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.520063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.522070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 94/172] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:35.523263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.533450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0c37-db7e-4223-8785-58679ecf49dd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.600656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.600656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.600957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.601204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] PATH_INFO: `/v3/users/0288e290a4f449a08f479aef090aafb0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.604770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] RBAC: Authorizing `identity:get_user(user_id=0288e290a4f449a08f479aef090aafb0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.606253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.608550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 79/173] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/users/0288e290a4f449a08f479aef090aafb0 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:35.609681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.618192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.635191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0676e1-17b9-420a-b878-f451c14bb713 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.682105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.682105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.682105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.682105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.756973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.758509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.837330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b410b-4bba-4fa1-b9b1-9a9154945749 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:35.856492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.859120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:35.875527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 95/174] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:35.875527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.924839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:35.925470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:35.925749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:35.926026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:35.926766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=4baafbf2b11a43589e472cfef377adf4) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:35.927247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:35.928753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:35.938547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 80/175] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/role_assignments?user.id=4baafbf2b11a43589e472cfef377adf4&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:35.939121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:35.989259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f13820-78c2-4f37-8ec3-f4b8c1c05dbd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:36.052963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:36.054006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.054498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.054975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.159904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138674a0-0761-445c-96af-c964ead38ab5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:36.179078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:36.213055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:36.216298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:36.232260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:36.233442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.233719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.233990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] PATH_INFO: `/v3/projects/df36f27d5ef049118aa03615aeb25da7` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.239785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] RBAC: Authorizing `identity:get_project(project_id=df36f27d5ef049118aa03615aeb25da7)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:36.239785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:36.240007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 81/176] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/projects/df36f27d5ef049118aa03615aeb25da7 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:36.246599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:36.348474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:36.398437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 96/177] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:36.404115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:36.472642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1523f-325a-4cf9-b43d-b4256cc537e5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:36.549440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:36.550067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.550341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.550608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.551650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=df36f27d5ef049118aa03615aeb25da7, user.id=0288e290a4f449a08f479aef090aafb0) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:36.551953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:36.553460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:36.556578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:36.568164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 82/178] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:36 2022] GET /identity/v3/role_assignments?user.id=0288e290a4f449a08f479aef090aafb0&scope.project.id=df36f27d5ef049118aa03615aeb25da7&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:36.581413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acb6e1-1a3e-4fac-9c88-d40492667cdc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:36.645260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b1331-2ff8-4884-afbe-c26374267720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:36.645917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1331-2ff8-4884-afbe-c26374267720 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.646192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1331-2ff8-4884-afbe-c26374267720 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.646462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b1331-2ff8-4884-afbe-c26374267720 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.653133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1331-2ff8-4884-afbe-c26374267720 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:36.654701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b1331-2ff8-4884-afbe-c26374267720 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:36.656858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 97/179] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:36 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:36.666107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:36.782259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a877ba-2847-4983-9d7b-003f549d20d6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.782543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a877ba-2847-4983-9d7b-003f549d20d6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.782826 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a877ba-2847-4983-9d7b-003f549d20d6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.784506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 98/180] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:36.805964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a45b0-ac83-4128-85e2-161230ab4348 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:36.811583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ef60a-7f66-454f-aa83-ca0a8a24fea7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.811918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ef60a-7f66-454f-aa83-ca0a8a24fea7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.812285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ef60a-7f66-454f-aa83-ca0a8a24fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.815578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:36.845296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:36.845916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:36.846199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:36.846483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:36.847219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] RBAC: Adding query filter params (role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=0288e290a4f449a08f479aef090aafb0) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:36.847579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:36.849386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8c836-bb42-4705-9ce4-c13856cf0f17 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:36.855493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 83/181] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:36 2022] GET /identity/v3/role_assignments?user.id=0288e290a4f449a08f479aef090aafb0&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:36.857281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0f4ef60a-7f66-454f-aa83-ca0a8a24fea7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:36.858675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0f4ef60a-7f66-454f-aa83-ca0a8a24fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:36.977943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 99/182] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:37.243237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8c5f-f5da-4398-a825-3cf8c7cf1a8a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.243639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8c5f-f5da-4398-a825-3cf8c7cf1a8a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.243834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd8c5f-f5da-4398-a825-3cf8c7cf1a8a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.245442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 84/183] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:37.251891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c453dd-d0e2-4276-8fda-ea24c836c8f5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.252958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c453dd-d0e2-4276-8fda-ea24c836c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.253433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c453dd-d0e2-4276-8fda-ea24c836c8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.274734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-10c453dd-d0e2-4276-8fda-ea24c836c8f5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:37.276333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-10c453dd-d0e2-4276-8fda-ea24c836c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:37.315395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd8c5f-f5da-4398-a825-3cf8c7cf1a8a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.354474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 100/184] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:37.372460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3dc6-e085-45c0-9ae0-70e8ff45ff09 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.372732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3dc6-e085-45c0-9ae0-70e8ff45ff09 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.373696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e3dc6-e085-45c0-9ae0-70e8ff45ff09 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.376613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 101/185] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:37.381488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.381951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.382379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.401134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:37.402571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:37.420460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.449244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd8c5f-f5da-4398-a825-3cf8c7cf1a8a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.480244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 102/186] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:37.486843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:37.487687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.488122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.488546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.500145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:37.505189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:37.512428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:37.513468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 85/187] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:37.514387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.634039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce20070-838c-463a-9364-fc1b875adb63 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.652836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.678898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:37.679903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.680415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.680903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.681777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:37.682285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:37.683919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:37.691362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.694053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 103/188] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:37.700055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.711222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.776979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999bc88-abc7-4aa5-86b0-f82585d2eaae None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.805135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c80c8d-e5b8-43e4-86d7-f53863e7646c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.810142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64154b0b-619c-40bd-b5f1-f49119d6dc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:37.811354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b0b-619c-40bd-b5f1-f49119d6dc87 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.811629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b0b-619c-40bd-b5f1-f49119d6dc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.811897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64154b0b-619c-40bd-b5f1-f49119d6dc87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.821771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64154b0b-619c-40bd-b5f1-f49119d6dc87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-64154b0b-619c-40bd-b5f1-f49119d6dc87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:37.826608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:37.828544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 86/189] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:37.829437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e417f-5e7b-45ae-ab83-2d8f996fb2ce None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.830312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e417f-5e7b-45ae-ab83-2d8f996fb2ce None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.830312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e417f-5e7b-45ae-ab83-2d8f996fb2ce None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.830659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 87/190] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:37.832334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e417f-5e7b-45ae-ab83-2d8f996fb2ce None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.846906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:37.847540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.847807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.848068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] PATH_INFO: `/v3/users/b090aa2cb7034c8e8186bd40ef32b825` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.861903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] RBAC: Authorizing `identity:get_user(user_id=b090aa2cb7034c8e8186bd40ef32b825)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:37.863419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:37.865124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 104/191] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/users/b090aa2cb7034c8e8186bd40ef32b825 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:37.865900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:37.927316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.927902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:37.937816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e417f-5e7b-45ae-ab83-2d8f996fb2ce None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.965802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5b92b-0c2a-40c7-b066-ede54e03eb0f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:37.971239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59562843-2773-4f5c-8f22-132ca9a479f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:37.971858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562843-2773-4f5c-8f22-132ca9a479f1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.972158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562843-2773-4f5c-8f22-132ca9a479f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.972425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59562843-2773-4f5c-8f22-132ca9a479f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.973616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562843-2773-4f5c-8f22-132ca9a479f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:37.975074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59562843-2773-4f5c-8f22-132ca9a479f1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:37.976808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 88/192] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:37.977927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:37.978203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:37.978473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:37.996693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:37.997968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:38.007323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.008011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.008321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.008591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.009252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:38.009550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.010907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.019634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 105/193] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:38.020460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.076700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 89/194] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:38.076700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.131281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4306ef-0b96-4045-b1e2-8f087cb1d8f3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.157932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.158279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.166925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.167536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.176281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.176281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.176459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92c75c-4297-43b4-922c-6573521388f1 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.203743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.204375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.204669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.204937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.205581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.207011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.237965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.239400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.307104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 90/195] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:38 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:38.307859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.361162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 106/196] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:38.362192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.396305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.431940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c901a-8c17-493c-9d34-d72aa2c3a6d3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.473514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.474158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.474431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.474706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] PATH_INFO: `/v3/users/b090aa2cb7034c8e8186bd40ef32b825` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.475867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] RBAC: Authorizing `identity:get_user(user_id=b090aa2cb7034c8e8186bd40ef32b825)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.477368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.479154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 91/197] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/users/b090aa2cb7034c8e8186bd40ef32b825 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:38.479886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.480690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0fb9f-9674-43dc-a6dd-e221ca84e554 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.501944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.532538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.533086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.533356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.533620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.550538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:38.555633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:38.556786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:38.557601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 107/198] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:38.558277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.601782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e58073-4574-4818-bc64-bb4108ecfad4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.652870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.653688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.654709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.654709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.656472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.657771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.659661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.660070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 92/199] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:38.661322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.681820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ded13d-7585-4236-b296-8c21f8be31b6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.722622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.723282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.723566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.723839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.775321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.802300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aca5ed-a481-474a-80ac-7b7aa28b4003 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:38.802634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.804145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.849009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:38.849619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:38.849894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:38.850164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:38.850833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:38.851134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:38.852602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:38.861516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 93/200] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:38.862192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.914357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:38.934206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 108/201] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:38.935294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:38.986510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1d460-46df-4517-a95f-a05b9acc34e3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.027671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.028326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.028607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.028879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.029651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=b090aa2cb7034c8e8186bd40ef32b825) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:39.029957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.031425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.037165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 94/202] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/role_assignments?user.id=b090aa2cb7034c8e8186bd40ef32b825&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:39.037965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:39.051773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af926ca-02e3-4c5a-8115-0d406c532d1f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.057365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:39.091371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.092606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.092884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.093156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] PATH_INFO: `/v3/users/526a900ae1af4ad189f9c704e5386f5f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.095590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] RBAC: Authorizing `identity:get_user(user_id=526a900ae1af4ad189f9c704e5386f5f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.097755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.099980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 109/203] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:38 2022] GET /identity/v3/users/526a900ae1af4ad189f9c704e5386f5f => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:39.105985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:39.204570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:39.229918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2ba45-f52d-4753-ac5e-ab2e005df920 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.274505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.275402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.275740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.276075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.325954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445a58-e39e-4583-8b58-669fed5d205d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.366814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.368485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.399921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.400641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.400924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.401190 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.404988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.406516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.408210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 95/204] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:39 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:39.414025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:39.444513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:39.483006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 110/205] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:39.489132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:39.602544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca22fcd-c328-4c94-9aa9-4bafbe17d4b5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.613335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:39.651526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec719d-3b58-46d4-9f1c-486e7f465373 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.680292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.680937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.681212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.681483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.683610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.685089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.687184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 111/206] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:39 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:39.697045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:39.713242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.713857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.714132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.714445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.715177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] RBAC: Adding query filter params (role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=b090aa2cb7034c8e8186bd40ef32b825) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:39.715526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.717639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85ee2c-ebe2-468d-bfc9-1717bb262317 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.727283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:39.730509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 96/207] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:39 2022] GET /identity/v3/role_assignments?user.id=b090aa2cb7034c8e8186bd40ef32b825&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:39.830433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c766f-7933-42d9-95b7-f61812e4053e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:39.867385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:39.868044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:39.868368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:39.868639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:39.869379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] RBAC: Adding query filter params (role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36, user.id=526a900ae1af4ad189f9c704e5386f5f) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:39.869681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:39.871137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c5dbc-668b-4b4f-bf6b-e5b587dc3d65 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:39.878684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 112/208] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:39 2022] GET /identity/v3/role_assignments?user.id=526a900ae1af4ad189f9c704e5386f5f&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:40.711377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bdbc-2c8d-457e-92c0-b0bf089252a6 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:40.712379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bdbc-2c8d-457e-92c0-b0bf089252a6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:40.712883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bdbc-2c8d-457e-92c0-b0bf089252a6 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:40.714517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 97/209] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:40.720696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4741fd-2b73-4181-9c1b-a30586292697 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:40.721509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4741fd-2b73-4181-9c1b-a30586292697 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:40.722000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4741fd-2b73-4181-9c1b-a30586292697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:40.740706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-dd4741fd-2b73-4181-9c1b-a30586292697 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:40.742196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dd4741fd-2b73-4181-9c1b-a30586292697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:40.818925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 113/210] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:40.902365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78e00-4de8-4ebe-b4fe-5862e20655ed None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:40.903001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78e00-4de8-4ebe-b4fe-5862e20655ed None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:40.903475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc78e00-4de8-4ebe-b4fe-5862e20655ed None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:40.905645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 98/211] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:40.911053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:40.911556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:40.912019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:40.930809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:40.932251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:40.943538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.005250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 114/212] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:41.095316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78e00-4de8-4ebe-b4fe-5862e20655ed None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:41.205343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc78e00-4de8-4ebe-b4fe-5862e20655ed None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.240780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.241404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.241674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.241937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.249038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.252697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:41.257497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:41.264497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:41.265308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 99/213] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:41.267613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:41.301402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:41.376906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5ac66-9463-4b54-95fe-5caef4652854 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.408423 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527085f5-f9a9-4858-983d-8f21693758f2 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.412840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.413472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.413750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.414083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.414765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:41.415123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:41.416629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:41.427705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 115/214] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:41.434045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:41.447208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.449728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.450404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.450677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.450939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.452134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:41.458807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:41.458807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 100/215] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:41.460726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:41.536216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.550021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce180f8e-0ad5-4e20-a405-2ce23dfd2069 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.572739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a159b5-a8e9-4133-92bf-34fd724e7982 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.588937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a8c8b-94cb-409a-8531-f2484591a703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.589590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a8c8b-94cb-409a-8531-f2484591a703 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.589866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a8c8b-94cb-409a-8531-f2484591a703 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.590135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a8c8b-94cb-409a-8531-f2484591a703 None admin] PATH_INFO: `/v3/users/f91e6d7c593e48a49ef1c2cd4629095b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.604999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a8c8b-94cb-409a-8531-f2484591a703 None admin] RBAC: Authorizing `identity:get_user(user_id=f91e6d7c593e48a49ef1c2cd4629095b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:41.606461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a8c8b-94cb-409a-8531-f2484591a703 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:41.612988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774af28d-91ef-4f03-a8dd-15b8582be813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.613152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 116/216] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:41 2022] GET /identity/v3/users/f91e6d7c593e48a49ef1c2cd4629095b => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:41.613230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774af28d-91ef-4f03-a8dd-15b8582be813 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.613230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774af28d-91ef-4f03-a8dd-15b8582be813 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.613230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774af28d-91ef-4f03-a8dd-15b8582be813 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.613418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569988-120e-4958-a7d3-35ac688091fb None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.613418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569988-120e-4958-a7d3-35ac688091fb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.613418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5569988-120e-4958-a7d3-35ac688091fb None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.613592 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774af28d-91ef-4f03-a8dd-15b8582be813 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:41.613659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 117/217] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:41.613722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774af28d-91ef-4f03-a8dd-15b8582be813 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:41.615546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569988-120e-4958-a7d3-35ac688091fb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:41.688499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.725161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 101/218] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:41 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:58:41.726412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.727017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.727017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.734059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5569988-120e-4958-a7d3-35ac688091fb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:41.754383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:41.755998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:41.788104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:41.789439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:41.790554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:41.791386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:41.843101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 102/219] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:41.882431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:41.884236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:41.953908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:41.991259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 118/220] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:41.996561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.052662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:42.108165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7735f6-ac43-4692-9331-cd769575d8a9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:42.117542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.157983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:42.159194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.159466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.159733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.162188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:42.163650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:42.165581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 103/221] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:41 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:42.171992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.242975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aab26-141e-4205-88b9-ee5ddbde2ec9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:42.281851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b37272-0bc2-4430-aaf2-5364c5b94c83 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:42.292916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab815591-14c7-41b6-9297-784c508ae0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:42.294279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815591-14c7-41b6-9297-784c508ae0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.295541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815591-14c7-41b6-9297-784c508ae0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.295992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab815591-14c7-41b6-9297-784c508ae0a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.304740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:42.312611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab815591-14c7-41b6-9297-784c508ae0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:42.319484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ab815591-14c7-41b6-9297-784c508ae0a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:42.319886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:42.328753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:42.329536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:42.330155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.330155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.330155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.330155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=f91e6d7c593e48a49ef1c2cd4629095b) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:42.330403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 119/222] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:42.330467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:42.330467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:42.331237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d0340-744f-4c74-b6ab-d1e075c7850f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.331757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d0340-744f-4c74-b6ab-d1e075c7850f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.333051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d0340-744f-4c74-b6ab-d1e075c7850f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.334201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 104/223] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:42 2022] GET /identity/v3/role_assignments?user.id=f91e6d7c593e48a49ef1c2cd4629095b&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:42.335043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 120/224] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:42 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:42.336388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.341576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.345444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.345444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.366828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:42.368241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:42.395080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:42.498426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 121/225] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:42.548703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a09c43-3857-4e6e-af94-36c08721980c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:42.591119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:42.592459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.592735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.592996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.593661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:42.593958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:42.595407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:42.604414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 105/226] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:42.609948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.726780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb8c61-2419-4814-8da5-674fa86d7d8e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:42.770680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:42.771447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:42.771614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:42.771761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] PATH_INFO: `/v3/users/b090aa2cb7034c8e8186bd40ef32b825` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:42.772973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] RBAC: Authorizing `identity:get_user(user_id=b090aa2cb7034c8e8186bd40ef32b825)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:42.774422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:42.776218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 122/227] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:42 2022] GET /identity/v3/users/b090aa2cb7034c8e8186bd40ef32b825 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:42.781890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.875611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:42.904561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:42.952231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be7bd9-f1d0-408a-b427-8765135a8cf1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:42.956436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:43.022125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.023273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.024039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.024538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.025876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:43.027565 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:43.030458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 106/228] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:42 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:43.036812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:43.106905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665ecc9-be79-401d-87cd-d5883dc6a64d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:43.169485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.170792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.171068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.171333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.182338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083322d9-21af-4776-a557-64bbfbd5d7b3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:43.192859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:43.197672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:43.199214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:43.200101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:43.200912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:43.208586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 123/229] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:58:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:43.215699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:43.222364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.223361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.224145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.224618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/b090aa2cb7034c8e8186bd40ef32b825/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.226774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46e5173ca4f6ab21d37c8772d9e73, user_id=b090aa2cb7034c8e8186bd40ef32b825, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:43.228518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:43.325056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 107/230] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:43 2022] PUT /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/b090aa2cb7034c8e8186bd40ef32b825/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:43.335064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:43.354744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac1cfb-935c-424e-b806-b196062a6a52 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:43.395036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.396162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.396653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.397172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.398091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:43.398616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:43.400319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:43.410909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 124/231] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:43.416731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:43.556492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8927b-e9e4-4b95-a34e-3d3e04c22401 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:43.600546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.601613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.602091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.602607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] PATH_INFO: `/v3/users/b090aa2cb7034c8e8186bd40ef32b825` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.604063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] RBAC: Authorizing `identity:get_user(user_id=b090aa2cb7034c8e8186bd40ef32b825)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:43.605730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:43.608122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 108/232] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:43 2022] GET /identity/v3/users/b090aa2cb7034c8e8186bd40ef32b825 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:43.613900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:43.730030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20d520-10ff-4077-8195-f94b43588493 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:43.767084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6222e3-9c50-4e51-a5b5-77363f6d5a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.767799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6222e3-9c50-4e51-a5b5-77363f6d5a16 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.768167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6222e3-9c50-4e51-a5b5-77363f6d5a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.768756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6222e3-9c50-4e51-a5b5-77363f6d5a16 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.769965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6222e3-9c50-4e51-a5b5-77363f6d5a16 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:43.771455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6222e3-9c50-4e51-a5b5-77363f6d5a16 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:43.773323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 125/233] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:43 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:43.779112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:43.833673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:43.898141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd3220-ebc0-478e-923b-b319214f9012 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:43.943280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89433fd1-e643-4343-88e9-559c7cccb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:43.943952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89433fd1-e643-4343-88e9-559c7cccb876 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:43.944256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89433fd1-e643-4343-88e9-559c7cccb876 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:43.944533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89433fd1-e643-4343-88e9-559c7cccb876 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/b090aa2cb7034c8e8186bd40ef32b825/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:43.946700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89433fd1-e643-4343-88e9-559c7cccb876 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46e5173ca4f6ab21d37c8772d9e73, user_id=b090aa2cb7034c8e8186bd40ef32b825, role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:43.948174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89433fd1-e643-4343-88e9-559c7cccb876 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:44.072933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 109/234] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:43 2022] PUT /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/b090aa2cb7034c8e8186bd40ef32b825/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:44.394228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fd2d1-ae92-4dd6-93dc-617ecbcf0c41 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.394616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fd2d1-ae92-4dd6-93dc-617ecbcf0c41 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.394814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fd2d1-ae92-4dd6-93dc-617ecbcf0c41 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.396601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 126/235] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:44.402585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d858-525a-4470-be5d-69ab31de2041 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.402912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d858-525a-4470-be5d-69ab31de2041 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.403129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d858-525a-4470-be5d-69ab31de2041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.424389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-eef1d858-525a-4470-be5d-69ab31de2041 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:44.425581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-eef1d858-525a-4470-be5d-69ab31de2041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:44.503230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 110/236] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:44.514734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d06f9-be72-44c7-9831-75d76d480f2f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.515335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d06f9-be72-44c7-9831-75d76d480f2f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.515810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d06f9-be72-44c7-9831-75d76d480f2f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.517662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 127/237] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:44.523179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607c6a-da4b-4553-8981-775cacda214b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.523460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607c6a-da4b-4553-8981-775cacda214b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.523729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607c6a-da4b-4553-8981-775cacda214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.550393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-68607c6a-da4b-4553-8981-775cacda214b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:44.551926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-68607c6a-da4b-4553-8981-775cacda214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:44.584438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:44.633647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 111/238] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:44.813060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d06f9-be72-44c7-9831-75d76d480f2f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:44.831453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:44.927476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d06f9-be72-44c7-9831-75d76d480f2f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:44.964988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:44.966023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:44.966494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:44.966997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:44.978631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:44.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:44.984994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:44.985787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:44.988275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 128/239] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:44.991608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607c6a-da4b-4553-8981-775cacda214b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:44.995830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.088468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.117261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1622155-0fb6-46a9-91cf-7ceb5e0daad5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.155954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.156943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.157415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.157879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.158763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] RBAC: Adding query filter params (name=reader) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:45.159258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:45.160851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:45.161898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607c6a-da4b-4553-8981-775cacda214b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.170616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 129/240] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:45.176597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.219742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73328684-97fd-4cdb-a814-bbb14f8e2792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.220336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328684-97fd-4cdb-a814-bbb14f8e2792 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.220606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328684-97fd-4cdb-a814-bbb14f8e2792 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.220871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73328684-97fd-4cdb-a814-bbb14f8e2792 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.221974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328684-97fd-4cdb-a814-bbb14f8e2792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:45.223416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73328684-97fd-4cdb-a814-bbb14f8e2792 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:45.225436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 112/241] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:45.226471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434c61-ab39-49f0-8c27-05dea406e81f None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.226750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434c61-ab39-49f0-8c27-05dea406e81f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.227120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87434c61-ab39-49f0-8c27-05dea406e81f None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.228400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 113/242] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:45.233510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434c61-ab39-49f0-8c27-05dea406e81f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.264462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.289423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea8d2f-b291-4393-a918-d1b341bb9ede None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.329585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbd6ec-92a5-4580-9fb8-271903fa246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.330247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbd6ec-92a5-4580-9fb8-271903fa246b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.330522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbd6ec-92a5-4580-9fb8-271903fa246b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.330793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbd6ec-92a5-4580-9fb8-271903fa246b None admin] PATH_INFO: `/v3/users/027ff87b785d46d2aedcb0c80010270b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.333905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.345642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbd6ec-92a5-4580-9fb8-271903fa246b None admin] RBAC: Authorizing `identity:get_user(user_id=027ff87b785d46d2aedcb0c80010270b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:45.348201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87434c61-ab39-49f0-8c27-05dea406e81f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.348306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fbd6ec-92a5-4580-9fb8-271903fa246b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:45.349063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 130/243] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:45 2022] GET /identity/v3/users/027ff87b785d46d2aedcb0c80010270b => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:45.354821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.355167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.355952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.375863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:45.377198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:45.386427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.387375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.387926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.388402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.389787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:45.391808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:45.451539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 131/244] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:45.457143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.496157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 114/245] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:45 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:45.582401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1374f5b-2970-4b57-8e65-7a2c9ec83bef None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.614065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.631649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.632298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.632572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.632840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.729008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:45.730487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:45.774519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.855181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 132/246] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:45.861345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:45.887391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.902728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:45.922363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86358a3d-ba0d-4066-a656-526fdf746fc0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.959452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:45.960445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:45.960913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:45.961464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:45.981927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:45.987532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27248f2b-1da6-40e3-a85c-6be9382121b0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:45.991164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:45.992498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:45.993310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:45.995427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 115/247] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:46.002536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:46.039906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:46.041074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.041487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.042147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.044296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.047170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.049393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 133/248] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:45 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:46.057268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:46.148519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f022-4511-480c-901d-109298cc6034 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:46.158022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:46.166784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e57b2-e3da-4bfb-ae6b-6d8046eec4b2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:46.190273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:46.190884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.191179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.191427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.192145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:46.192503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.194878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.206292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 116/249] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:46.206613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:46.207350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.207627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.207890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.208703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] RBAC: Adding query filter params (role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=027ff87b785d46d2aedcb0c80010270b) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:46.209048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.210491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.211948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:46.216965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 134/250] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:46 2022] GET /identity/v3/role_assignments?user.id=027ff87b785d46d2aedcb0c80010270b&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:46.228392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:46.339529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be999e9-cc24-4789-b86b-f6feec37c0a3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:46.379796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902a86c-131e-47ed-8c9b-161ff7b0d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:46.380484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902a86c-131e-47ed-8c9b-161ff7b0d879 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.380801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902a86c-131e-47ed-8c9b-161ff7b0d879 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.381075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902a86c-131e-47ed-8c9b-161ff7b0d879 None admin] PATH_INFO: `/v3/users/f91e6d7c593e48a49ef1c2cd4629095b` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.382269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902a86c-131e-47ed-8c9b-161ff7b0d879 None admin] RBAC: Authorizing `identity:get_user(user_id=f91e6d7c593e48a49ef1c2cd4629095b)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.383816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902a86c-131e-47ed-8c9b-161ff7b0d879 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.385631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 117/251] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:46 2022] GET /identity/v3/users/f91e6d7c593e48a49ef1c2cd4629095b => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:46.391764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:46.454558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b995a-b8f1-4ec8-91c9-0998fdf70228 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.454864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b995a-b8f1-4ec8-91c9-0998fdf70228 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.455144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b995a-b8f1-4ec8-91c9-0998fdf70228 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.456742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 118/252] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:46.463198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.463467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.463732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.486522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:46.487702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:46.511495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa4683-bf67-42b4-a395-0977be7d1ee5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:46.570602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 119/253] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:46.601660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff9e1-caae-4cd9-8d68-64e574dad80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:46.602270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff9e1-caae-4cd9-8d68-64e574dad80e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.602549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff9e1-caae-4cd9-8d68-64e574dad80e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.602816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff9e1-caae-4cd9-8d68-64e574dad80e None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.604814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff9e1-caae-4cd9-8d68-64e574dad80e None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.606484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff9e1-caae-4cd9-8d68-64e574dad80e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.608531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 135/254] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:46 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:46.614222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:46.623768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:46.773433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608454e-4b87-45e1-99d5-cd6192648436 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:46.820049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:46.820739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.821012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.821277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/f91e6d7c593e48a49ef1c2cd4629095b/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.823170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46e5173ca4f6ab21d37c8772d9e73, user_id=f91e6d7c593e48a49ef1c2cd4629095b, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:46.824639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:46.867218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab24c-6f53-4d29-8c4f-b7b9f18e8545 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.868386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab24c-6f53-4d29-8c4f-b7b9f18e8545 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.868860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ab24c-6f53-4d29-8c4f-b7b9f18e8545 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.870524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 136/255] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:46.876193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe068284-12c3-473a-909b-33f111161bfb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:46.878424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe068284-12c3-473a-909b-33f111161bfb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:46.878424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe068284-12c3-473a-909b-33f111161bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:46.905338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 120/256] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:46 2022] PUT /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/f91e6d7c593e48a49ef1c2cd4629095b/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:46.913672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fe068284-12c3-473a-909b-33f111161bfb None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:46.915222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fe068284-12c3-473a-909b-33f111161bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:46.933568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:46.950214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:47.050641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:47.066914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 137/257] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:47.086717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3f6de-aeda-4961-95b1-1f1f0d5b0ea4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:47.125321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:47.132284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.132284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.132284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.139091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:47.145396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:47.146508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:58:47.147513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:47.149626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 121/258] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:58:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:47.155875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe068284-12c3-473a-909b-33f111161bfb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:47.290318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe068284-12c3-473a-909b-33f111161bfb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:47.329096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:47.330037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.330489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.330933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.331775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:47.332276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:47.333867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:47.345330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 138/259] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:47.351570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:47.465991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e3731-4c40-4d33-b2ce-6c6d18e028cf None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:47.492912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:47.502159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:47.502798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.503072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.503341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] PATH_INFO: `/v3/users/b090aa2cb7034c8e8186bd40ef32b825` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.504492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] RBAC: Authorizing `identity:get_user(user_id=b090aa2cb7034c8e8186bd40ef32b825)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:47.506004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:47.508021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 122/260] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:47 2022] GET /identity/v3/users/b090aa2cb7034c8e8186bd40ef32b825 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:47.518196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:47.552159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:47.636674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:47.674071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18c72f-3200-4a21-abb9-33ae913b93ba None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:47.767268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:47.767812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.768110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.768419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.867737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96372648-8c80-45d1-bd45-3c645e429f5f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:47.928887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:47.929827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:47.930279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:47.930748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:47.946863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:47.954280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:47.955186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:58:47.957981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:47.964007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 123/261] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:58:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:47.964654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:47.966151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:47.967151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:48.009938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:48.065005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:48.170712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c91c4-51f4-4fa4-850f-d6f80b7ffe41 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:48.220622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 139/262] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:48.227587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:48.249083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:48.249713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:48.249990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:48.250264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:48.250939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:48.251240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:48.252669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:48.262013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 124/263] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:58:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:48.268561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:48.409115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb90074-cc09-4c1d-8422-07f94ed0bbb1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:48.426898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:48.447379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:48.451445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:48.451445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:48.451445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:48.451445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:48.452322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:48.456103 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 140/264] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:48 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:48.466041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:48.467356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b929036-9666-4ca0-a26c-a09792872089 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:48.497476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:48.540962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:48.541835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:48.542036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:48.542285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] PATH_INFO: `/v3/users/b090aa2cb7034c8e8186bd40ef32b825` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:48.543995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] RBAC: Authorizing `identity:get_user(user_id=b090aa2cb7034c8e8186bd40ef32b825)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:48.545935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:48.553531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 125/265] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:48 2022] GET /identity/v3/users/b090aa2cb7034c8e8186bd40ef32b825 => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:48.570125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:48.601126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785189a-e65a-40e0-ab0d-0c047d0c6240 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:48.639873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:48.640876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:48.641372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:48.642111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:48.643054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=b090aa2cb7034c8e8186bd40ef32b825) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:48.643597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:48.645309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:48.652162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 141/266] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:48 2022] GET /identity/v3/role_assignments?user.id=b090aa2cb7034c8e8186bd40ef32b825&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:48.777749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956df5bd-f02f-43d6-997e-2c384d724a6b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:48.828745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:48.829376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:48.829654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:48.829927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:48.903498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:48.928112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:48.930004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:49.048180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 126/267] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:58:49.054211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:49.119048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:49.179291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016683bd-5e2d-4f91-8a0a-1f2d59df65f4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:49.223503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772549f-959a-4cdf-919b-314069d35f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:49.224227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772549f-959a-4cdf-919b-314069d35f93 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.224506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772549f-959a-4cdf-919b-314069d35f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.224777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772549f-959a-4cdf-919b-314069d35f93 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.225941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772549f-959a-4cdf-919b-314069d35f93 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:49.227488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772549f-959a-4cdf-919b-314069d35f93 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:49.229461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 142/268] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:49 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:49.235439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:49.335006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:49.353813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eddb8-2d26-4cf5-ae04-7c7844e2b2cd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:49.405552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:49.406231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.406512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.406782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.407526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] RBAC: Adding query filter params (role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=b090aa2cb7034c8e8186bd40ef32b825) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:49.407832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:49.409368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69339e0-c7af-459c-b568-845f80b57f45 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:49.416404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 127/269] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:49 2022] GET /identity/v3/role_assignments?user.id=b090aa2cb7034c8e8186bd40ef32b825&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:49.533912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc13c-7103-4ae3-bacd-7cec3b98a63e None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.534104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc13c-7103-4ae3-bacd-7cec3b98a63e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.534372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc13c-7103-4ae3-bacd-7cec3b98a63e None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.535952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 143/270] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:49.542060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662ae97-c3c3-46db-bf98-0375505b7e94 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.542659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662ae97-c3c3-46db-bf98-0375505b7e94 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.543155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662ae97-c3c3-46db-bf98-0375505b7e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.553478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd12d4e-f921-4e8f-b9aa-b80434dadd77 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.554078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd12d4e-f921-4e8f-b9aa-b80434dadd77 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.554566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd12d4e-f921-4e8f-b9aa-b80434dadd77 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.556625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 144/271] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:49.566603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.567194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.567660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.567907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3662ae97-c3c3-46db-bf98-0375505b7e94 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:49.569150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3662ae97-c3c3-46db-bf98-0375505b7e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:49.605436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:49.607037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:49.668170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 128/272] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:49.670553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba0740-c6c7-4e8d-832a-f285d1523f06 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.671225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba0740-c6c7-4e8d-832a-f285d1523f06 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.672295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba0740-c6c7-4e8d-832a-f285d1523f06 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.674902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 129/273] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:49.683085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:49.683614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:49.684064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:49.704407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:49.705883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:49.715004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 145/274] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:49.778827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 130/275] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:49.952325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.002069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.010625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.013768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.086901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a97bc0-3056-41a8-8fca-416855f0028a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.125925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.126126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0149138-d0d6-45ee-8fe4-6cf68f8e5c4f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.127041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.127518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.127964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.139923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:50.146010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:50.147004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:50.147912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:50.152345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 146/276] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:50.153186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.169555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.170392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.170540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.170772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.181892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:50.187346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:50.188301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 131/277] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:50.193875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.263225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.276663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90c729-4186-4f0e-a82c-044ebd5a8408 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.284677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.300420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafc321-4550-451d-b465-f69a0fc32d5e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.311728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.312392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.312661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.312928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.314023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.315477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.317081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 147/278] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:50.317834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.336785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.337387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.337656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.337918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.338661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:50.338952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.340347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942ff3e-1a7c-4df1-9855-8414e6706ccf None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.348942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 132/279] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:50.350086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b346-2d87-4a12-a2e5-871480e7f775 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.350361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b346-2d87-4a12-a2e5-871480e7f775 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.350626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b346-2d87-4a12-a2e5-871480e7f775 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.351820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 133/280] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:50.352523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b346-2d87-4a12-a2e5-871480e7f775 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.421682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be3b93-7cdf-4ab8-a147-47c8502f1072 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.454006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b346-2d87-4a12-a2e5-871480e7f775 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.454498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.455112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.455390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.455659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.456348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:50.456650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.458021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.466174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 148/281] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:50.468510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.483301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.488875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e6ab1-f22b-4352-9aa2-a41ad3bc3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.489468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e6ab1-f22b-4352-9aa2-a41ad3bc3fec None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.489737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e6ab1-f22b-4352-9aa2-a41ad3bc3fec None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.489998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e6ab1-f22b-4352-9aa2-a41ad3bc3fec None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.490646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e6ab1-f22b-4352-9aa2-a41ad3bc3fec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.492059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e6ab1-f22b-4352-9aa2-a41ad3bc3fec None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.503113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.565739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411042e1-fbc2-4795-84d8-68aadef05fd6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.598541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.599188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.599465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.599848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] PATH_INFO: `/v3/users/027ff87b785d46d2aedcb0c80010270b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.601021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] RBAC: Authorizing `identity:get_user(user_id=027ff87b785d46d2aedcb0c80010270b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.601991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 134/282] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:58:50 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:58:50.602562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.603193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.603495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.603767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.609124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 149/283] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/users/027ff87b785d46d2aedcb0c80010270b => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:50.612738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.625676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:50.626901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:50.709044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 135/284] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:50.709993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.750970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d713f3f-e0b3-4ea7-afed-9deb4663fef6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.754902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.806298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.806910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.807462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.809167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] PATH_INFO: `/v3/users/ae38920237124f2b8b275778eee83d7b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.826916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] RBAC: Authorizing `identity:get_user(user_id=ae38920237124f2b8b275778eee83d7b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.830526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.834405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 150/285] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/users/ae38920237124f2b8b275778eee83d7b => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:50.843587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:50.845985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8f603-465a-45e7-be1b-f7d3898c60a8 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:50.870399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:50.912615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:50.913982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:50.915006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:50.915006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:50.916073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:50.919075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:50.921654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 136/286] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:50.928914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:51.042831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d362624-785f-4faf-8a84-82891ae024ee None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.085067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.085606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.085880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.086148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:51.088048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, user.id=ae38920237124f2b8b275778eee83d7b, scope.system=all) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:51.088605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:51.089805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:51.096688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236adc37-0eb2-4b85-bbdf-978e64b988ae None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.100136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 151/287] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 7 12:58:50 2022] GET /identity/v3/role_assignments?user.id=ae38920237124f2b8b275778eee83d7b&scope.system=all&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:51.100136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:51.142486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.174739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.175493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.175774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.176043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/027ff87b785d46d2aedcb0c80010270b/roles/2bf3a3b90a23411ab1e0539e3ff3e5a8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:51.178193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46e5173ca4f6ab21d37c8772d9e73, user_id=027ff87b785d46d2aedcb0c80010270b, role_id=2bf3a3b90a23411ab1e0539e3ff3e5a8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:51.179700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:51.309018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 137/288] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:58:50 2022] PUT /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/users/027ff87b785d46d2aedcb0c80010270b/roles/2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:58:51.311057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b40b32-43b6-4185-9970-53077200f373 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.352315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.352884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.353161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.353430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:51.366179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:51.371731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:51.373155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:51.374043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 152/289] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:51.379559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:51.448367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.526850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f822578-8ee1-4727-bd6d-fa55fe352d79 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.572516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.573233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.573514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.573785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:51.574449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:51.574748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:51.576183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:51.585911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 138/290] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:51.592481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:51.691320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.706187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca863-c717-4012-9753-b1523b3decbc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.751167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.751809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.752106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.752371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] PATH_INFO: `/v3/users/f91e6d7c593e48a49ef1c2cd4629095b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:51.753521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] RBAC: Authorizing `identity:get_user(user_id=f91e6d7c593e48a49ef1c2cd4629095b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:51.755039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:51.756749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 153/291] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:51 2022] GET /identity/v3/users/f91e6d7c593e48a49ef1c2cd4629095b => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:51.762834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:51.900932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8fc6c-a70e-43d8-841c-5190f3bc63ce None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:51.914213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:51.954464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:51.954988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:51.955259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:51.955523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:52.025694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:52.027221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:52.148872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 139/292] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:52.154810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:52.311046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8dbae-aa4e-4786-aea4-6f5719cba718 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:52.356780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55722311-5157-452d-b723-366bf7f37ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:52.357972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55722311-5157-452d-b723-366bf7f37ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:52.358244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55722311-5157-452d-b723-366bf7f37ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:52.358510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55722311-5157-452d-b723-366bf7f37ed9 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:52.359723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55722311-5157-452d-b723-366bf7f37ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:52.361212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55722311-5157-452d-b723-366bf7f37ed9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:52.362840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 154/293] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:52 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:52.368887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:52.381128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:52.503853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa70c52-679c-4c29-9563-793f516c16c5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:52.538018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:52.538712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:52.538983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:52.539248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:52.539964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=f91e6d7c593e48a49ef1c2cd4629095b) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:52.540292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:52.541777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78188b5-6140-4218-9f7d-50e04dfdd33f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:52.547970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 140/294] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:52 2022] GET /identity/v3/role_assignments?user.id=f91e6d7c593e48a49ef1c2cd4629095b&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:53.384498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd28af-cf6d-440e-b3c0-282735223d22 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.385016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd28af-cf6d-440e-b3c0-282735223d22 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.385016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd28af-cf6d-440e-b3c0-282735223d22 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.386528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 155/295] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:53.393102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce02e-f47d-4272-ada1-9c676d97a8f1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.393905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce02e-f47d-4272-ada1-9c676d97a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.394395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbce02e-f47d-4272-ada1-9c676d97a8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.410676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7002a-38f4-4f32-9c30-15afffd1081c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.410958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7002a-38f4-4f32-9c30-15afffd1081c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.411205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7002a-38f4-4f32-9c30-15afffd1081c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.412821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 156/296] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:53.414550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9dbce02e-f47d-4272-ada1-9c676d97a8f1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:53.415928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9dbce02e-f47d-4272-ada1-9c676d97a8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:53.417598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.417873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.418142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.437913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:53.439076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:53.458651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:53.496943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:53.503584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 141/297] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:53.523073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 157/298] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:53.782028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45745-b0f7-4df4-90af-0d40d6e18817 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.782346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45745-b0f7-4df4-90af-0d40d6e18817 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.782574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a45745-b0f7-4df4-90af-0d40d6e18817 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.784148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 142/299] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:53.784512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:53.788867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.789144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.789411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.808271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:53.809447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:53.884522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 143/300] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:53.884522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:53.900676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f46f5-1c6d-466d-a211-6b796e3bfe50 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:53.947030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:53.948393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:53.948819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:53.949493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:53.950973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:53.953364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:53.955119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 158/301] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:53.962152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:53.989130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c981bd-0666-468e-b0bf-53242cbda5a2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:53.994072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.021522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.029893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.030729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.031299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.032052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.048662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:54.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:54.054720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:54.055520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:54.056618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 144/302] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:54.060431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.112360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4efa67-1b42-4e50-b5e7-548da33c3969 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.159821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e051b1-ff59-4c8a-9430-3e9fa871a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.160486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e051b1-ff59-4c8a-9430-3e9fa871a010 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.160760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e051b1-ff59-4c8a-9430-3e9fa871a010 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.161028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e051b1-ff59-4c8a-9430-3e9fa871a010 None admin] PATH_INFO: `/v3/groups` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.161655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e051b1-ff59-4c8a-9430-3e9fa871a010 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.163084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e051b1-ff59-4c8a-9430-3e9fa871a010 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.175406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ee0b-1cef-414e-8229-38fd0cdd0203 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.210205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.210704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.210982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.211278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.211941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:54.212300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.213734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.221794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 145/303] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:54.222817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.233714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 159/304] 10.222.0.57 () {60 vars in 1134 bytes} [Wed Sep 7 12:58:53 2022] POST /identity/v3/groups => generated 229 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:58:54.234962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02a8-47b4-4041-8ece-8fd64abe07ac None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.235249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02a8-47b4-4041-8ece-8fd64abe07ac None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.235683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c02a8-47b4-4041-8ece-8fd64abe07ac None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.236777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 160/305] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:54.242115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02a8-47b4-4041-8ece-8fd64abe07ac None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.283985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.340636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.341130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59019710-919f-48ba-9aca-9cb420d2f90c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.362989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c02a8-47b4-4041-8ece-8fd64abe07ac None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.380792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88914bdb-df32-452f-bf8d-36ca46951a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.381441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914bdb-df32-452f-bf8d-36ca46951a9b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.381718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914bdb-df32-452f-bf8d-36ca46951a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.382082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88914bdb-df32-452f-bf8d-36ca46951a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.395783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88914bdb-df32-452f-bf8d-36ca46951a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-88914bdb-df32-452f-bf8d-36ca46951a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:54.401294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:54.402367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:54.403176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 146/306] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:54.403822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.403822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.409144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.409369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.410556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.411396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.411664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] PATH_INFO: `/v3/users/08e55fdd9a9141e9ab5dcf40b059f45f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.426147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:54.427080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:54.428508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] RBAC: Authorizing `identity:get_user(user_id=08e55fdd9a9141e9ab5dcf40b059f45f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.430951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.433016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 161/307] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/users/08e55fdd9a9141e9ab5dcf40b059f45f => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:54.433858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.504070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 147/308] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:54.505295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.553001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd68b61-7883-4903-974a-4f8bd2227b51 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.561499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.596991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.598036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.598316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.598593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.599270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:54.599572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.601416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.608774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.616147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 162/309] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:54.618874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.634549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef9d20-5277-453c-983a-33d42c4f6399 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.692453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.693489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.693768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.694040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.695126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] RBAC: Adding query filter params (role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8, user.id=08e55fdd9a9141e9ab5dcf40b059f45f, scope.system=all) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:54.695437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.697591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.704593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 148/310] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/role_assignments?user.id=08e55fdd9a9141e9ab5dcf40b059f45f&scope.system=all&role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:54.750721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bfe82-0c7f-4465-b13b-061b5640515d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.791984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.795425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.796126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.796458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.796734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] PATH_INFO: `/v3/users/ae38920237124f2b8b275778eee83d7b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.798113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] RBAC: Authorizing `identity:get_user(user_id=ae38920237124f2b8b275778eee83d7b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.799668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.801462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 163/311] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/users/ae38920237124f2b8b275778eee83d7b => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:54.807360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:54.894467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.917776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d02ece-2085-4b5b-a311-4af5edf699c2 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.928056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:54.939544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffec7b-844e-4093-8d1b-68070592e06b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:54.966906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.968167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.969082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.969811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.976510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:54.977169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:54.977442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:54.977709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] PATH_INFO: `/v3/system/users/ae38920237124f2b8b275778eee83d7b/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:54.979115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ae38920237124f2b8b275778eee83d7b, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:54.980586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:54.984957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:54.990342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:54.991317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:54.992201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:58:54.996216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 149/312] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:55.002175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:55.056851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 164/313] 10.222.0.57 () {58 vars in 1334 bytes} [Wed Sep 7 12:58:54 2022] PUT /identity/v3/system/users/ae38920237124f2b8b275778eee83d7b/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:58:55.116856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83701a10-c73a-4a37-8cac-b2c72a703641 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:55.157806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:55.158427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:55.158752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:55.159025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:55.159697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:55.159995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:55.161514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:55.176536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 150/314] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:58:55.178475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:55.288662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f7c93-d449-4fbe-879a-f8f5d9a35432 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:55.317859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:55.324720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:55.325335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:55.325608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:55.326447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] PATH_INFO: `/v3/users/027ff87b785d46d2aedcb0c80010270b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:55.327700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] RBAC: Authorizing `identity:get_user(user_id=027ff87b785d46d2aedcb0c80010270b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:55.329262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:55.330974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 165/315] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:55 2022] GET /identity/v3/users/027ff87b785d46d2aedcb0c80010270b => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:55.337160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:55.369492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:55.446111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8f4d2-6ffe-4b28-b050-b1467666727f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:55.483055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:55.483898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:55.484337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:55.484740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:55.557789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:55.559697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:55.590681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:55.668061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 151/316] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:58:55.677272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:55.781849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d602465b-e8cd-443c-8d82-3ed4f6162197 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:55.821746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0acf3f-fe40-4dfb-9610-fae0a2746c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:55.822772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0acf3f-fe40-4dfb-9610-fae0a2746c66 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:55.823243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0acf3f-fe40-4dfb-9610-fae0a2746c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:55.823735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0acf3f-fe40-4dfb-9610-fae0a2746c66 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:55.825211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0acf3f-fe40-4dfb-9610-fae0a2746c66 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:55.827033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0acf3f-fe40-4dfb-9610-fae0a2746c66 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:55.829222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 166/317] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:58:55 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:55.835504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:55.942708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55549efe-d7de-4136-b715-4aa242fc980b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:55.969157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:55.977010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:55.977616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:55.977887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:55.978151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:55.978867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] RBAC: Adding query filter params (role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73, user.id=027ff87b785d46d2aedcb0c80010270b) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:55.979166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:55.980640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ccfba-a718-40e7-8e3b-5daa496e93f7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:55.987604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 152/318] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:58:55 2022] GET /identity/v3/role_assignments?user.id=027ff87b785d46d2aedcb0c80010270b&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:56.549450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b91db-2a42-486b-abec-d119592b1727 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:56.549825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b91db-2a42-486b-abec-d119592b1727 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:56.550005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b91db-2a42-486b-abec-d119592b1727 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:56.551396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 167/319] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:56.557074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3925-f304-49e0-a99f-e646ea2df653 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:56.557773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3925-f304-49e0-a99f-e646ea2df653 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:56.557773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3925-f304-49e0-a99f-e646ea2df653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:56.575652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-42db3925-f304-49e0-a99f-e646ea2df653 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:56.577389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-42db3925-f304-49e0-a99f-e646ea2df653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:56.647312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 153/320] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:58:56.920867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b91db-2a42-486b-abec-d119592b1727 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:56.991963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:56.995985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a786d6-41c9-4cf2-b58c-a40663cc8c4a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:56.996295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a786d6-41c9-4cf2-b58c-a40663cc8c4a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:56.996568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a786d6-41c9-4cf2-b58c-a40663cc8c4a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:56.998617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 154/321] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:57.003398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebe475-e87e-4aef-819f-1271f5ea09b7 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.003679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebe475-e87e-4aef-819f-1271f5ea09b7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.003951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebe475-e87e-4aef-819f-1271f5ea09b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.022667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c0ebe475-e87e-4aef-819f-1271f5ea09b7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:57.023862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c0ebe475-e87e-4aef-819f-1271f5ea09b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:57.028613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b91db-2a42-486b-abec-d119592b1727 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:57.064142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:57.064775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.065472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.065749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.067233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:57.068861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:57.070482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 168/322] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:58:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:57.076428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.094629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 155/323] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:57.180221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7068cc-e9a5-4fe3-95ab-db27d9c7e1a5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:57.218378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:57.218994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.219269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.219540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] PATH_INFO: `/v3/groups` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.220198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:57.221639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:57.227103 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:57.299664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bb5ed-96db-489e-bc47-71dd31ad205f None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.299948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bb5ed-96db-489e-bc47-71dd31ad205f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.300286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bb5ed-96db-489e-bc47-71dd31ad205f None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.301705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 156/324] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:58:57.306582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de10e2-78a7-465d-9217-50f94894451b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.306865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de10e2-78a7-465d-9217-50f94894451b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.307172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de10e2-78a7-465d-9217-50f94894451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.312905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 169/325] 10.222.0.57 () {60 vars in 1134 bytes} [Wed Sep 7 12:58:57 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 12:58:57.331374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-31de10e2-78a7-465d-9217-50f94894451b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:57.332661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-31de10e2-78a7-465d-9217-50f94894451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:57.361018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.393868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:57.417564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 157/326] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:58:57.480818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55b53-849a-4de5-83b4-f8f2ab7825b1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:57.520715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:57.521358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.521629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.521898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.533484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:57.539145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:57.540051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:57.540870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 170/327] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:58:57.546410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de10e2-78a7-465d-9217-50f94894451b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.663193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de10e2-78a7-465d-9217-50f94894451b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:57.689582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.699081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:57.699696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.699971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.700272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.701514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:57.701814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:57.703731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:57.715150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 158/328] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:57.720819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.770608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:57.779404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:57.831110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82927a9-0685-4c5d-8ced-41822f18f9ed None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:57.848958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf17326-ac6e-4ddf-b360-9408f5b1fa70 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:57.867210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:57.868063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.868482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.868821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.883732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:58:57.889653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:58:57.890552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:58:57.891343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 171/329] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:58:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:58:57.892282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:57.895272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:57.895562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:57.895896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] PATH_INFO: `/v3/users/08e55fdd9a9141e9ab5dcf40b059f45f` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:57.898265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] RBAC: Authorizing `identity:get_user(user_id=08e55fdd9a9141e9ab5dcf40b059f45f)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:57.898811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:57.899870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:57.900731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 159/330] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:57 2022] GET /identity/v3/users/08e55fdd9a9141e9ab5dcf40b059f45f => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:57.906715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:58.014557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1b064-8558-431f-8fdb-798d8cb8f70a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:58.020588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52984c47-a340-46f8-a191-9d808f32cd9f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:58.034022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:58.038622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:58:58.053500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:58.054109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:58.054385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:58.054653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:58.055921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:58.055921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:58.057116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:58.063782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:58.064743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:58.065252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:58.065716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] PATH_INFO: `/v3/system/users/08e55fdd9a9141e9ab5dcf40b059f45f/roles/2bf3a3b90a23411ab1e0539e3ff3e5a8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:58.068112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 172/331] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:58:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:58.073274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=08e55fdd9a9141e9ab5dcf40b059f45f, role_id=2bf3a3b90a23411ab1e0539e3ff3e5a8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:58.074300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:58.074515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:58.183902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14cb0-564a-44ae-95f7-38402664e1e0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:58.193471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 160/332] 10.222.0.57 () {58 vars in 1334 bytes} [Wed Sep 7 12:58:57 2022] PUT /identity/v3/system/users/08e55fdd9a9141e9ab5dcf40b059f45f/roles/2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:58:58.224932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7dd51-cc89-4a34-ac9b-dbe7b3ddc962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:58.225843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7dd51-cc89-4a34-ac9b-dbe7b3ddc962 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:58.226289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7dd51-cc89-4a34-ac9b-dbe7b3ddc962 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:58.226704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7dd51-cc89-4a34-ac9b-dbe7b3ddc962 None admin] PATH_INFO: `/v3/users/ae38920237124f2b8b275778eee83d7b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:58.228210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7dd51-cc89-4a34-ac9b-dbe7b3ddc962 None admin] RBAC: Authorizing `identity:get_user(user_id=ae38920237124f2b8b275778eee83d7b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:58.229921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7dd51-cc89-4a34-ac9b-dbe7b3ddc962 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:58.231778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 173/333] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:58:58 2022] GET /identity/v3/users/ae38920237124f2b8b275778eee83d7b => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:58.238014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:58:58.356845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df593-7055-42e1-8105-d4b0830c3e70 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:58:58.399763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:58:58.400418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:58.400693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:58.400957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:58.401697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] RBAC: Adding query filter params (role.id=0f3e19b9978840ecaeca5e5135b809ca, user.id=ae38920237124f2b8b275778eee83d7b, scope.system=all) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:58:58.401997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:58:58.403465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77d665-fedb-4304-9fe6-fa30ab5d769a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:58:58.422002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 161/334] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 7 12:58:58 2022] GET /identity/v3/role_assignments?user.id=ae38920237124f2b8b275778eee83d7b&scope.system=all&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:58:59.897857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5333b13-2d3e-40f6-b84f-0e3e0e5d5d06 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:59.898851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5333b13-2d3e-40f6-b84f-0e3e0e5d5d06 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:59.899334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5333b13-2d3e-40f6-b84f-0e3e0e5d5d06 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:59.901238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 174/335] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:58:59.906646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db7f6d-9e98-4606-9aa6-b56c8e2e9568 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:58:59.907528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db7f6d-9e98-4606-9aa6-b56c8e2e9568 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:58:59.908047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db7f6d-9e98-4606-9aa6-b56c8e2e9568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:58:59.928452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f1db7f6d-9e98-4606-9aa6-b56c8e2e9568 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:58:59.929947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f1db7f6d-9e98-4606-9aa6-b56c8e2e9568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:58:59.965128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:00.006605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 162/336] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:00.203503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a26fb-42b8-475f-b044-8951b81ef006 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.203800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a26fb-42b8-475f-b044-8951b81ef006 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.203976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a26fb-42b8-475f-b044-8951b81ef006 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.205378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 175/337] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:00.222624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.223223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.223691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.247145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:00.248931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:00.334182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 163/338] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:00.402328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a26fb-42b8-475f-b044-8951b81ef006 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:00.479027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:00.548000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a26fb-42b8-475f-b044-8951b81ef006 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:00.591100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:00.592185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.592667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.593130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.605566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:00.613633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:00.620460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:00.621265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 176/339] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:00.621914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:00.723466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:00.760719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:00.771414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72613f9-500b-4e9c-be80-bfc32f7ee618 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:00.833757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969616c-b486-4917-bae3-498f766b14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:00.834420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969616c-b486-4917-bae3-498f766b14da None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.834701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969616c-b486-4917-bae3-498f766b14da None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.834977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969616c-b486-4917-bae3-498f766b14da None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.835713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969616c-b486-4917-bae3-498f766b14da None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:00.836019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969616c-b486-4917-bae3-498f766b14da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:00.837445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969616c-b486-4917-bae3-498f766b14da None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:00.850405 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 164/340] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:00.856186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969616c-b486-4917-bae3-498f766b14da None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:00.868823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f03a9f-7638-462f-95e3-19771a6e9262 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:00.879179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:00.949863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:00.950526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:00.950873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:00.951146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:00.976600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:00.981864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:00.983001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:00.983919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:00.989693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 177/341] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:00.996280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.070274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969616c-b486-4917-bae3-498f766b14da None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.111107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdf17d-673c-460b-aef8-f77a1ff68142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.112102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdf17d-673c-460b-aef8-f77a1ff68142 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.112618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdf17d-673c-460b-aef8-f77a1ff68142 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.113013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdf17d-673c-460b-aef8-f77a1ff68142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.152234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.178614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cc198a-8325-4ffe-972b-b1a1baddfc39 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.218860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.219837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.220403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.220881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.221733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:01.222239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.223919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639baa7-74be-4ca2-a8e8-765ab773a00a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.229134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdf17d-673c-460b-aef8-f77a1ff68142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.230595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdf17d-673c-460b-aef8-f77a1ff68142 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.236484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 178/342] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:01.238087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c10996-93f7-428a-b564-1eb7a1ebcbec None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.238561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c10996-93f7-428a-b564-1eb7a1ebcbec None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.239043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c10996-93f7-428a-b564-1eb7a1ebcbec None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.240521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 179/343] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:01.241943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c10996-93f7-428a-b564-1eb7a1ebcbec None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.273691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.356557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c10996-93f7-428a-b564-1eb7a1ebcbec None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.380170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 165/344] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:01.381567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.381854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.382124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.395081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762381e-493e-482d-b028-b2999158d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.396133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762381e-493e-482d-b028-b2999158d74b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.396622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762381e-493e-482d-b028-b2999158d74b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.397080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3762381e-493e-482d-b028-b2999158d74b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.401962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:01.403147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:01.459271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.473388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762381e-493e-482d-b028-b2999158d74b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.475221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3762381e-493e-482d-b028-b2999158d74b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.476438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 166/345] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:01.477306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.508245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.583570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe347-c273-4bd4-bbc7-0d21700aad05 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.589028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 180/346] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:01.597032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762381e-493e-482d-b028-b2999158d74b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.619212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.619770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.620049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.624209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.624209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.624209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.625120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 167/347] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:01.630564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.749939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.776077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3762381e-493e-482d-b028-b2999158d74b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.813507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359bec1-e2ff-4f72-9f3b-5e5e705db5c3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:01.837149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:01.864571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.864571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.864887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.865102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.867749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:01.868430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:01.868710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:01.868984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:01.871593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.873880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.875950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 181/348] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:01.876392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:01.877867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:01.879860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 168/349] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:01.885374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:01.885528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:02.024707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9fa231-5472-4e8e-b0b3-75465d334f12 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.051196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5492ed-b3e6-45c9-900f-dcef617876bd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.059577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.060331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.060711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.060891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.061603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:02.062864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:02.063338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:02.069370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 182/350] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:02.070011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:02.077318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:02.112209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a802d-52dc-4031-b412-1d1eece5e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.116035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a802d-52dc-4031-b412-1d1eece5e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.116586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a802d-52dc-4031-b412-1d1eece5e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.117006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a802d-52dc-4031-b412-1d1eece5e2b6 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.118653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a802d-52dc-4031-b412-1d1eece5e2b6 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:02.121502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a802d-52dc-4031-b412-1d1eece5e2b6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:02.126741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 169/351] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:01 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:02.129086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a1150-02b1-4eee-b860-cc0bb3a7a192 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.129682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a1150-02b1-4eee-b860-cc0bb3a7a192 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.131332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a1150-02b1-4eee-b860-cc0bb3a7a192 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.133713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 170/352] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:02.135369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a1150-02b1-4eee-b860-cc0bb3a7a192 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:02.197927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:02.280620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190142f-b566-44d8-bf7d-fddb7622ea30 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.339182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a1150-02b1-4eee-b860-cc0bb3a7a192 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.340770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967bd4a2-b160-4559-83ad-3b1ce4a5ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.341936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bd4a2-b160-4559-83ad-3b1ce4a5ed33 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.342216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bd4a2-b160-4559-83ad-3b1ce4a5ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.342478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967bd4a2-b160-4559-83ad-3b1ce4a5ed33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.359939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967bd4a2-b160-4559-83ad-3b1ce4a5ed33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-967bd4a2-b160-4559-83ad-3b1ce4a5ed33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:02.365515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:02.366413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:02.367215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 183/353] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:02.367869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.368526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.368526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.404678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.405231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.405504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.406619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:02.407837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:02.408140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.408945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:02.409253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:02.410740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:02.425142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 171/354] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:02 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:02.426018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:02.531395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:02.585847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 184/355] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:02.598793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbed85-ed28-4573-9383-1cca065b03a7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.636394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.637074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.637351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.637620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.638482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:02.638782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:02.640241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44925e-ffff-47c6-8b07-25cce4af15a6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:02.649874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 172/356] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:02.656243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:02.687649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312f3cf-afdc-4d1c-9d16-c92b5d9675d2 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.688364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312f3cf-afdc-4d1c-9d16-c92b5d9675d2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.688652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312f3cf-afdc-4d1c-9d16-c92b5d9675d2 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.690616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 173/357] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:02.699121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f9087-c35d-4365-b3ce-1f9e1c56c33e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.699531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f9087-c35d-4365-b3ce-1f9e1c56c33e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.699809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f9087-c35d-4365-b3ce-1f9e1c56c33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.724404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a55f9087-c35d-4365-b3ce-1f9e1c56c33e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:02.725636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a55f9087-c35d-4365-b3ce-1f9e1c56c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:02.749449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:02.813045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 174/358] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:02.861256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72e15-f48e-4593-ac9b-fc53b3ccc192 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:02.912884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:02.913423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.913694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.913959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.954413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24c26d-f27d-4bbb-8a51-9158838fb965 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.954748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24c26d-f27d-4bbb-8a51-9158838fb965 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.954954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24c26d-f27d-4bbb-8a51-9158838fb965 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.956649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 175/359] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:02.961578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:02.961859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:02.962120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:02.999536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:03.000996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:03.058519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.062818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.064341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.102222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 176/360] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:03.103199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.200555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.229525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5500858-99dd-48f4-9292-556b8a117c2d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.276882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.277522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.277799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.278066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.279115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 185/361] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:03.284338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.290340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:03.296658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:03.298765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 177/362] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:03.300863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.341092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.406013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fef6e1-d6e5-48f8-aedc-49e616e686df None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.428725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7903c-8495-4ae5-9482-e097b5300feb None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.444316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.445288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.445790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.446272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.460212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:03.465655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:03.467100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:03.467903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:03.470333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.470794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 186/363] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:03.470961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.471193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.471464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.472461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.476417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.478411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.480493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 178/364] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:03.487394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.488587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.579053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1874f7-0f57-4f85-8850-677d6894e07d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.603251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.607236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653adb5-2bbc-4815-b2ab-5ea0c79686bf None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.617859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.618844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.619393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.619862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.620768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:03.621280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.623470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.632613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 187/365] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:03.633699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.645319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.645964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.646290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.646621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.648974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.650516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.652621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 179/366] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:03.653502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.712109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.744447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36857eea-5b7d-451c-95b6-0a8a505f4276 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.775055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21a9bf-a6e4-4fe3-bf15-a5eaed24d2d6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.781508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.782131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.782407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.782740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.783408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:03.783707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.785120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.795037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 188/367] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:03.795880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.818785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.819524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.819807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.820111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] PATH_INFO: `/v3/users/08e55fdd9a9141e9ab5dcf40b059f45f` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.821253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] RBAC: Authorizing `identity:get_user(user_id=08e55fdd9a9141e9ab5dcf40b059f45f)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.822905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.825044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 180/368] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/users/08e55fdd9a9141e9ab5dcf40b059f45f => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:03.826130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.865382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.904008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72c05-81bd-48a3-b055-ac5e17d815a8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.940031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.940252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109c593-8b96-42a3-a408-dc5b6afc491f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:03.940689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.941019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.941292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.943432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:03.953180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:03.960835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:03.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 189/369] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:03.962514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:03.979886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:03.981508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:03.981790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:03.982618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:03.983355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:03.983662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:03.985248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:03.991831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 181/370] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:03.992496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.075626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888d93-1dde-4930-943a-f26b513531a9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.113364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.113852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.114329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.114329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.114489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.118738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e10881-51ae-4c5e-8f65-618bf0ed6419 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.161042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.161954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.162377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.162818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.163853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] RBAC: Adding query filter params (role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8, user.id=08e55fdd9a9141e9ab5dcf40b059f45f, scope.system=all) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:04.164382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.166073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.181263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 182/371] 10.222.0.57 () {56 vars in 1308 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/role_assignments?user.id=08e55fdd9a9141e9ab5dcf40b059f45f&scope.system=all&role.id=2bf3a3b90a23411ab1e0539e3ff3e5a8 => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:04.182343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.186654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.195580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.197183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.306978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc0f6-c478-4bf5-8017-2e3c2d867af5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.311953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 190/372] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:04.317914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.348786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.349855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.350284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.350703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.351539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:04.352045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.353827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.364184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 183/373] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:04.373784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.404679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.452484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.462255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c048137-14a7-40c2-adf6-0c54299656b1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.524992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be3ff0c-2aaa-4bd2-9fa3-399ca380a816 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.540950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.541992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.542541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.543038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.546447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.548211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.550559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 191/374] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:04.557832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.583894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.584539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.584814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.585078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.696829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092e169-d473-444c-89fc-d15fc2bfb708 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.713782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.715379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.734885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.735585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.735868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.736170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.737288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.738740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.740690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 192/375] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:04.743938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.746494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.779795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:04.859479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c60925-0ef1-4c19-a22d-c6ee22f596a5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:04.896476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:04.897454 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:04.897903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:04.898317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:04.899193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:04.899742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:04.902075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26871dcf-1fc5-4900-a421-c0443b68a85d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:04.904708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 184/376] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:04.910168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:04.910369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 193/377] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:05.048932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f896-71c9-4cca-9aab-ba3524dc8354 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:05.050947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941dad-c241-499f-a175-ce337baf37f0 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.051477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941dad-c241-499f-a175-ce337baf37f0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.051949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87941dad-c241-499f-a175-ce337baf37f0 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.053688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 194/378] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:05.060500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.060785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.061065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.081129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:05.093171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:05.093841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.094115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.097732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] PATH_INFO: `/v3/projects/07da914e24704120962aa1acd6dda617` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.097732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] RBAC: Authorizing `identity:get_project(project_id=07da914e24704120962aa1acd6dda617)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:05.097732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:05.098726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:05.099178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 185/379] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:04 2022] GET /identity/v3/projects/07da914e24704120962aa1acd6dda617 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:05.100018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:05.104618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:05.241924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 195/380] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:05.286481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d78f79-7860-43c8-bcac-cf0182b79684 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:05.322287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:05.322920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.323255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.323531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] PATH_INFO: `/v3/groups/c95a1639127e4c7cbd10c26ba170a8f3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.333477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] RBAC: Authorizing `identity:get_group(group_id=c95a1639127e4c7cbd10c26ba170a8f3)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:05.335005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:05.336887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 186/381] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:05 2022] GET /identity/v3/groups/c95a1639127e4c7cbd10c26ba170a8f3 => generated 229 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:05.343690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:05.374246 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:05.463368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703099c8-d045-45c9-ac95-fff2529c3c76 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:05.514773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:05.515801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.516321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.516801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.518034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] RBAC: Adding query filter params (group.id=c95a1639127e4c7cbd10c26ba170a8f3, role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=07da914e24704120962aa1acd6dda617) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:05.518539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:05.520201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:05.526999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 196/382] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:05 2022] GET /identity/v3/role_assignments?group.id=c95a1639127e4c7cbd10c26ba170a8f3&scope.project.id=07da914e24704120962aa1acd6dda617&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:05.749907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:05.812152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:05.878698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f250906-e5e2-459f-845b-1959d9c4a77a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:05.921143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38372da0-9b6c-4793-bddd-22c15d60fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:05.922124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38372da0-9b6c-4793-bddd-22c15d60fa14 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.922606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38372da0-9b6c-4793-bddd-22c15d60fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.923074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38372da0-9b6c-4793-bddd-22c15d60fa14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.936590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38372da0-9b6c-4793-bddd-22c15d60fa14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-38372da0-9b6c-4793-bddd-22c15d60fa14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:05.942326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:05.943221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:05.944039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:05.948867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 187/383] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:05.955397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:05.990175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e150c-168f-49e7-81b1-1adc74fa781c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:05.990819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e150c-168f-49e7-81b1-1adc74fa781c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:05.991293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e150c-168f-49e7-81b1-1adc74fa781c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:05.993132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 188/384] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:05.999762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.000331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.000806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.029124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:06.032110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:06.103618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:06.128769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287a62e-fa2c-4e92-8e51-52618f2eb7a4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:06.162371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 189/385] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:06.172560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:06.173184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.173509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.173785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.174455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:06.174758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:06.176134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:06.184665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 197/386] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:06.190869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:06.238082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:06.300925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd03ff-b32c-4ee3-996d-84940e58a41c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:06.337125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:06.338057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.338512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.338959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.340319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:06.342025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:06.344186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 190/387] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:06 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:06.349905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:06.463987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9480c-9f68-4d68-bbfc-22f798a73197 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:06.503470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:06.504507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.504977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.505430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.506769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:06.508439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:06.510574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 198/388] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:06 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:06.517340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:06.624502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50319799-ff8b-4ffe-9bf4-d222b3e32df0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:06.635813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:06.660625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:06.661300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.661578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.661846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/groups/eab802925e854e9b9fee964c2437c5c6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.664465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1f6ffbba488ba6e3432cd797be36, group_id=eab802925e854e9b9fee964c2437c5c6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:06.665916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:06.729989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:06.751268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 191/389] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 7 12:59:06 2022] PUT /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/groups/eab802925e854e9b9fee964c2437c5c6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:06.762457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:06.873805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788578f-ecdd-4c75-9dd7-c803687d09af None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:06.921610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3f0b-20b8-4b51-9ca0-60f4c9fb7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:06.922388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3f0b-20b8-4b51-9ca0-60f4c9fb7ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.923478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3f0b-20b8-4b51-9ca0-60f4c9fb7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.923478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3f0b-20b8-4b51-9ca0-60f4c9fb7ef7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.943557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb3f0b-20b8-4b51-9ca0-60f4c9fb7ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b1fb3f0b-20b8-4b51-9ca0-60f4c9fb7ef7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:06.948590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:06.949562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:06.950402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 199/390] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:06.957218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:06.958936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d820-1b11-4ea0-9bac-bfbf3356adef None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.959215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d820-1b11-4ea0-9bac-bfbf3356adef None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.959482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7d820-1b11-4ea0-9bac-bfbf3356adef None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:06.962815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 200/391] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:06.967556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:06.967831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:06.968110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.007083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:07.008312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:07.136197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 201/392] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:07.154452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d20db-e239-48d5-9b33-eccc10e8269d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.196323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:07.197325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.197810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.198292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.199167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:07.199681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:07.201884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:07.211047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 192/393] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:07.217103 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:07.228893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.333729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e976-8392-4e81-9f5a-c183275acc5f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.375428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:07.376521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.377067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.377537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.378966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:07.380664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:07.385767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 202/394] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:07 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:07.388856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:07.426223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.505594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab74cd-aebd-4404-8113-47e66d618cdd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.545016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:07.546047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.546496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.546942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.548296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:07.549953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:07.552045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 193/395] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:07 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:07.558065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:07.563435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:07.718587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.726251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edff015-a028-4b97-8771-c1b23c417769 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.746420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:07.772362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:07.774196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.774196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.774507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.779700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9b60b-70e8-466b-92be-cf5143eedd2b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.787920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:07.793905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:07.795524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:07.796585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:07.797661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 194/396] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:07.804423 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:07.850888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5f9ed-1659-4286-a76c-641efd686170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:07.851728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f9ed-1659-4286-a76c-641efd686170 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.852034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f9ed-1659-4286-a76c-641efd686170 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.852347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5f9ed-1659-4286-a76c-641efd686170 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/groups/eab802925e854e9b9fee964c2437c5c6/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.858505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f9ed-1659-4286-a76c-641efd686170 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1f6ffbba488ba6e3432cd797be36, group_id=eab802925e854e9b9fee964c2437c5c6, role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:07.860234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5f9ed-1659-4286-a76c-641efd686170 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:07.944194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 203/397] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 7 12:59:07 2022] PUT /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36/groups/eab802925e854e9b9fee964c2437c5c6/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:07.968828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6c37-bcc3-476a-818e-669f19809afc None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.969150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6c37-bcc3-476a-818e-669f19809afc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.969489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6c37-bcc3-476a-818e-669f19809afc None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:07.970977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 204/398] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:07.971799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997765d1-577b-4f33-b525-5e80fa44046b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:07.980513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:07.980841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:07.981066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.022071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:08.025142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:08.039591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:08.040639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.041205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.041684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.042584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:08.043153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:08.044845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:08.063364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 195/399] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:08.070442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:08.129194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:08.178076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 205/400] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:08.240563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fba46f-4a88-4821-9e27-0dcd9c1edef0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:08.280627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:08.281272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.281550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.281824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.282955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:08.284437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:08.286037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 196/401] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:08 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:08.291912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:08.375254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:08.419771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a869a-b993-4ec1-b95c-ed5c3569a984 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:08.462719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:08.463375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.463649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.464031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.465202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:08.467429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:08.473927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 206/402] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:08 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:08.482158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:08.587739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:08.591568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:08.601850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6d823-1bf4-4b5d-b898-7beb86bdec75 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:08.642863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:08.643667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.643936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.644240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/groups/eab802925e854e9b9fee964c2437c5c6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.647441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46e5173ca4f6ab21d37c8772d9e73, group_id=eab802925e854e9b9fee964c2437c5c6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:08.647710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:08.756202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 197/403] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 7 12:59:08 2022] PUT /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/groups/eab802925e854e9b9fee964c2437c5c6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:08.757505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921dfde-d44d-4273-adaa-fa74ef214f4a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:08.799607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b2db0-782c-4747-b624-6de22d85fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:08.800281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2db0-782c-4747-b624-6de22d85fcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.800612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2db0-782c-4747-b624-6de22d85fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.800880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b2db0-782c-4747-b624-6de22d85fcf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.802985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:08.818806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b2db0-782c-4747-b624-6de22d85fcf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ee0b2db0-782c-4747-b624-6de22d85fcf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:08.824064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:08.825068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:08.826571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:08.827800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 207/404] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:08.832277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:08.852543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c538-f4f2-44ff-93fc-7aad6334016d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.852876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c538-f4f2-44ff-93fc-7aad6334016d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.853033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c538-f4f2-44ff-93fc-7aad6334016d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.854769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 208/405] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:08.860464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:08.860752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:08.860983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:08.894905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:08.896176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:09.024400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e9bde-62c9-4861-99d8-8030ec132d34 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:09.061741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 209/406] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:09.071637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:09.072291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.072566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.072832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.073504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:09.073800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:09.075197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:09.088222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 198/407] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:09.090724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:09.218310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60092bc-09d1-4be7-a5b6-d3f868f4c731 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:09.243989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:09.255290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:09.257690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.257690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.257690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.257690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:09.259085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:09.261038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 210/408] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:09 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:09.267412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:09.296114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:09.394018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207477f6-2a97-41ba-a799-2866d442473f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:09.408097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:09.445068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:09.445742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.446021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.446296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.448426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:09.451265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:09.457611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 199/409] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:09 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:09.459337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:09.553315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9758b7-9515-4cef-87ec-d385c33738c4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:09.557250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:09.579693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca5055-45dc-4341-a151-b35fc99958ba None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:09.590508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bbb3e-9343-4e40-9d18-b9b0588762e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:09.591713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bbb3e-9343-4e40-9d18-b9b0588762e8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.591991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bbb3e-9343-4e40-9d18-b9b0588762e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.592965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bbb3e-9343-4e40-9d18-b9b0588762e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.604117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bbb3e-9343-4e40-9d18-b9b0588762e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-9e2bbb3e-9343-4e40-9d18-b9b0588762e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:09.609963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:09.610841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:09.611627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 211/410] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:09.616464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532539b5-5aad-4ad2-8828-1a468c075cdd None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.616744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532539b5-5aad-4ad2-8828-1a468c075cdd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.617014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532539b5-5aad-4ad2-8828-1a468c075cdd None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.619046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 212/411] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:09.619922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532539b5-5aad-4ad2-8828-1a468c075cdd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:09.620543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759fa8c-b34c-40bb-a1ce-03a2824b89cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:09.621403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759fa8c-b34c-40bb-a1ce-03a2824b89cb None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.621678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759fa8c-b34c-40bb-a1ce-03a2824b89cb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.621958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759fa8c-b34c-40bb-a1ce-03a2824b89cb None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/groups/eab802925e854e9b9fee964c2437c5c6/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.629072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759fa8c-b34c-40bb-a1ce-03a2824b89cb None admin] RBAC: Authorizing `identity:create_grant(project_id=ecc46e5173ca4f6ab21d37c8772d9e73, group_id=eab802925e854e9b9fee964c2437c5c6, role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:09.630545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759fa8c-b34c-40bb-a1ce-03a2824b89cb None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:09.679492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:09.706662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 200/412] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 7 12:59:09 2022] PUT /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73/groups/eab802925e854e9b9fee964c2437c5c6/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:09.709172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.709675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.710331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.736462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:09.738588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:09.756882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532539b5-5aad-4ad2-8828-1a468c075cdd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:09.829622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 201/413] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:09.845781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:09.846898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:09.847423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:09.847904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:09.848891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:09.849457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:09.851117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:09.862186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 213/414] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:09.867635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:09.948569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:09.981007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7e0d7-4da1-4d29-a5c9-597c65334552 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.018516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.019146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.019419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.019687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] PATH_INFO: `/v3/groups/c95a1639127e4c7cbd10c26ba170a8f3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.021030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] RBAC: Authorizing `identity:get_group(group_id=c95a1639127e4c7cbd10c26ba170a8f3)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:10.022903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:10.027725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 202/415] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:09 2022] GET /identity/v3/groups/c95a1639127e4c7cbd10c26ba170a8f3 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:10.031325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.123024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.155388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77f99-b2ab-428b-a463-0f951cd96c37 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.172620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:10.194250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.197634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.197634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.197634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] PATH_INFO: `/v3/projects/07da914e24704120962aa1acd6dda617` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.197634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] RBAC: Authorizing `identity:get_project(project_id=07da914e24704120962aa1acd6dda617)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:10.198770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:10.201478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 214/416] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:10 2022] GET /identity/v3/projects/07da914e24704120962aa1acd6dda617 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:10.207313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.284450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca748d5d-7283-49de-bd62-066145202f96 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.327729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.328411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.328685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.328950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.342780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:10.347740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:10.348659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:10.349456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 203/417] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:10.350952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:10.355069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.400139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc31ae-a20c-47ff-9a26-c1821821c646 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.464819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83181f46-a069-41a9-a8d2-c551d5c26dc5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.489381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.490071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.494951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.494951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] PATH_INFO: `/v3/projects/07da914e24704120962aa1acd6dda617/groups/c95a1639127e4c7cbd10c26ba170a8f3/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.500871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] RBAC: Authorizing `identity:create_grant(project_id=07da914e24704120962aa1acd6dda617, group_id=c95a1639127e4c7cbd10c26ba170a8f3, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:10.501398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.502008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.502283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.502390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:10.502549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.503207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] RBAC: Adding query filter params (name=member) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:10.503561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:10.505057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:10.514412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 204/418] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:10.520014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.583551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:10.610629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 215/419] 10.222.0.57 () {58 vars in 1442 bytes} [Wed Sep 7 12:59:10 2022] PUT /identity/v3/projects/07da914e24704120962aa1acd6dda617/groups/c95a1639127e4c7cbd10c26ba170a8f3/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 12:59:10.630354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f4c1a-dcf7-41b3-86a1-7b1695d19a90 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:10.669714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e5bb-5855-4f52-8517-445c67bdb69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:10.671089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e5bb-5855-4f52-8517-445c67bdb69a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.671468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e5bb-5855-4f52-8517-445c67bdb69a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.671854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e5bb-5855-4f52-8517-445c67bdb69a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.749165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08e5bb-5855-4f52-8517-445c67bdb69a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:10.751043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08e5bb-5855-4f52-8517-445c67bdb69a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:10.826865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:10.865899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 205/420] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:10.877272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:10.911775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae4fd-b2b4-422d-aeb2-5c1691189e69 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.912334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae4fd-b2b4-422d-aeb2-5c1691189e69 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.912769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae4fd-b2b4-422d-aeb2-5c1691189e69 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.915201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 206/421] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:10.929822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:10.930303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:10.930712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:10.950952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:10.952441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:10.960425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:11.015935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19743f-4349-4625-b361-f86b198fa74e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:11.033256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 207/422] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:11.055822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:11.056677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.057067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.057434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.058668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:11.060794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:11.062741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 216/423] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:10 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:11.068472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:11.180309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:11.194841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae099-bf42-4677-a4cf-5cb832f44f3d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:11.235376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:11.236108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.236463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.236797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.238030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:11.239550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:11.246041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 208/424] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:11 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:11.247434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:11.351074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1642c-3d53-4d5b-9c88-28148013babc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:11.361946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:11.386054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:11.386715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.387756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.387756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.388034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:11.388326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:11.389807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:11.396432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 217/425] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:11 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:11.407631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:11.543497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533032-0154-4fdf-ab76-6367c17d9e9b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:11.594775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:11.595453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.595752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.595952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.613851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:11.618895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:11.619859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:11.620683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 209/426] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:11.626440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:11.771218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3c94a-d6bd-4c5d-910c-a5214005314c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:11.809702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:11.810283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.810556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.810823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.811484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:11.811782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:11.813258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39ef54-396c-4814-8441-cb56a7e6f9d2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:11.828561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 218/427] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:11.833278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:11.860514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:11.962829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b514f0-1e89-4a32-9294-d1a2ddf9623b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:11.964251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e95d-e155-4cab-82b4-790db7baf4ac None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.964539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e95d-e155-4cab-82b4-790db7baf4ac None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.964815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568e95d-e155-4cab-82b4-790db7baf4ac None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.968167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 219/428] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:11.973428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:11.973767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:11.974047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:11.999404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:12.000641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:12.010436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a90d8-e83f-423c-9405-497f61dca1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.011042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a90d8-e83f-423c-9405-497f61dca1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.011313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a90d8-e83f-423c-9405-497f61dca1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.011578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a90d8-e83f-423c-9405-497f61dca1a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.037978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.083219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 220/429] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:12.086794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a90d8-e83f-423c-9405-497f61dca1a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:12.088277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a90d8-e83f-423c-9405-497f61dca1a5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:12.107478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.196376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 210/430] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:12.203851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.240545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac33a4-ad3a-4142-ba0e-a53a8a068435 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.241111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac33a4-ad3a-4142-ba0e-a53a8a068435 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.241380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac33a4-ad3a-4142-ba0e-a53a8a068435 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.242850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 211/431] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:12.249702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.250306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.251671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.273997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:12.275496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:12.343685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a529d6-3194-4a49-9093-7dc053c48d7c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.357395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 212/432] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:12.379884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.380550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.380820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.381084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] PATH_INFO: `/v3/projects/1cda1f6ffbba488ba6e3432cd797be36` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.382277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] RBAC: Authorizing `identity:get_project(project_id=1cda1f6ffbba488ba6e3432cd797be36)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:12.383758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:12.385800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 221/433] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/projects/1cda1f6ffbba488ba6e3432cd797be36 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:12.391648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.394459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.429980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.456503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.501044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b350b-c8c2-4522-a4aa-5c36a8700705 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.511452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7f87a-a43c-42f3-892a-ff0860bac570 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.537816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.538457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.538732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.539006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.551360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:12.556226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:12.557110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:12.558279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 222/434] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:12.559233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.559233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.559233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.559233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.560776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:12.562831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:12.563327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.566205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 213/435] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:12.571169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.675821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.682622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb26f-5de2-4c40-8636-fc70ed675448 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.695241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b923359-00ac-435f-ac9f-266c597af00d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.712897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:12.719734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.720631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.725059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.725059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.725059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] RBAC: Adding query filter params (name=member) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:12.725059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:12.725059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:12.731454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.732705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.732981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.733245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.733961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=1cda1f6ffbba488ba6e3432cd797be36) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:12.738940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:12.739060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 223/436] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:12.739060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.739212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:12.742107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 214/437] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=1cda1f6ffbba488ba6e3432cd797be36&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:12.743148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.860942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581f8e-0209-4e96-9faf-e76a799dd015 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.901116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6781c9-09fc-4bd3-8c35-d906054a8216 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:12.905610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.906392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.906773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.907202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.920441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:12.925527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:12.926519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:12.927398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:12.928003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 224/438] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:12.933579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:12.952400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:12.953125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:12.953400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:12.953668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:12.956746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.025319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.049293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.051202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.064943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad812d90-00a7-4b1c-bf53-014dacb2c82a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.108309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.109297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.109783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.110348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.111028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:13.111348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.112762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.122278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 225/439] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:13.129057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.189422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 215/440] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:13.195182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.238766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.267440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e856b1f-21f0-4e61-a783-10a220955180 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.296239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.305062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630b55b-7f18-4584-af68-87bee2d991b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.305669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630b55b-7f18-4584-af68-87bee2d991b1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.305942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630b55b-7f18-4584-af68-87bee2d991b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.306210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630b55b-7f18-4584-af68-87bee2d991b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.314803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114ef4a-0814-4a94-a2d6-5d9b2c01f97e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.349953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2764fd-5ed4-4e14-a156-2dfd4517bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.350582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2764fd-5ed4-4e14-a156-2dfd4517bea9 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.350859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2764fd-5ed4-4e14-a156-2dfd4517bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.351133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2764fd-5ed4-4e14-a156-2dfd4517bea9 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.352273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2764fd-5ed4-4e14-a156-2dfd4517bea9 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.353716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2764fd-5ed4-4e14-a156-2dfd4517bea9 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.355348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 216/441] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:13.358017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c30c2a-78f1-4990-9482-a0c9e517dc8f None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.358281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c30c2a-78f1-4990-9482-a0c9e517dc8f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.358541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c30c2a-78f1-4990-9482-a0c9e517dc8f None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.360622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 217/442] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:13.361321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c30c2a-78f1-4990-9482-a0c9e517dc8f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.375035 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630b55b-7f18-4584-af68-87bee2d991b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.376523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630b55b-7f18-4584-af68-87bee2d991b1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.451056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.463609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c30c2a-78f1-4990-9482-a0c9e517dc8f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.473964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 226/443] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:13.475564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.475996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.476290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.494484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:13.495688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:13.500005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.500709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.500992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.501266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.502406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.503827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.505425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 218/444] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:13.508135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.524373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.567884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 227/445] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:13.576986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.605730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e3ca-5641-4260-a51d-6fd1654d5339 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.639725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.640363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.640635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.640915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] PATH_INFO: `/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.641996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] RBAC: Authorizing `identity:get_project(project_id=ecc46e5173ca4f6ab21d37c8772d9e73)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.643689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.649845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 219/446] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/projects/ecc46e5173ca4f6ab21d37c8772d9e73 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:13.650659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.687201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbd3f5-ab74-464d-9594-5165d0e8b9a0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.698340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.724257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.724945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.725216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.725482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.726231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=0f3e19b9978840ecaeca5e5135b809ca, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:13.726533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.728137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.735835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 228/447] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=0f3e19b9978840ecaeca5e5135b809ca => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:13.741072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:13.758936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa1ea-83b3-4c26-a2db-ed065d114b63 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.797021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.797672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.797950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.798221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] PATH_INFO: `/v3/groups/eab802925e854e9b9fee964c2437c5c6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.799433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] RBAC: Authorizing `identity:get_group(group_id=eab802925e854e9b9fee964c2437c5c6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.800952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.802811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 220/448] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/groups/eab802925e854e9b9fee964c2437c5c6 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:13.808601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.837123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:13.930682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d8ae1-de6c-4788-850f-2b30a8e3d95c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.950619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a90e57-3eb5-43fa-a347-8b5367f55dd9 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:13.970223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.970831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.971104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.971362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:13.972098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] RBAC: Adding query filter params (group.id=eab802925e854e9b9fee964c2437c5c6, role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:13.973285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:13.974886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:13.981020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 229/449] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/role_assignments?group.id=eab802925e854e9b9fee964c2437c5c6&scope.project.id=ecc46e5173ca4f6ab21d37c8772d9e73&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:13.991871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:13.992587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:13.992864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:13.993138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.005506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:14.010589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:14.011569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:14.012473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:14.014359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 221/450] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:14.018615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:14.060616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:14.134154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15f50-41ae-4c14-adb9-97e3705b2e1d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:14.173138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:14.173867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:14.174149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:14.174422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.175097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:14.175395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:14.176796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:14.185870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 230/451] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:14.191727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:14.207898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:14.297215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd642d97-4167-4c8a-bc63-f86ffe59bcee None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:14.331994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:14.332687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:14.332963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:14.333231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.402921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:14.404930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:14.418408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:14.500511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 222/452] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:14.506280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:14.600842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:14.604448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22914fa7-bbb2-41bd-b8fe-1a3478469ba0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:14.636277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:14.636893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:14.637168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:14.637436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] PATH_INFO: `/v3/projects/07da914e24704120962aa1acd6dda617` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.639060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] RBAC: Authorizing `identity:get_project(project_id=07da914e24704120962aa1acd6dda617)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:14.640706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:14.642579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 231/453] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 12:59:14 2022] GET /identity/v3/projects/07da914e24704120962aa1acd6dda617 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:14.648099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:14.748526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b0c3a-918d-44e8-adb0-a06204f69987 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:14.760873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:14.782253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11381796-e85d-408e-b80f-3c29cb8709a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:14.789355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381796-e85d-408e-b80f-3c29cb8709a6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:14.789355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381796-e85d-408e-b80f-3c29cb8709a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:14.789355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381796-e85d-408e-b80f-3c29cb8709a6 None admin] PATH_INFO: `/v3/groups/c95a1639127e4c7cbd10c26ba170a8f3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.789355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11381796-e85d-408e-b80f-3c29cb8709a6 None admin] RBAC: Authorizing `identity:get_group(group_id=c95a1639127e4c7cbd10c26ba170a8f3)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:14.789355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11381796-e85d-408e-b80f-3c29cb8709a6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:14.789355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 223/454] 10.222.0.57 () {56 vars in 1180 bytes} [Wed Sep 7 12:59:14 2022] GET /identity/v3/groups/c95a1639127e4c7cbd10c26ba170a8f3 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:14.793272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:14.887783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527da52-b55c-44bf-86f1-9a7686229393 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:14.920541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:14.921471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:14.921934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:14.922408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:14.923146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] RBAC: Adding query filter params (group.id=c95a1639127e4c7cbd10c26ba170a8f3, role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=07da914e24704120962aa1acd6dda617) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:14.923433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:14.925250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa05a2-a422-4de8-829c-06d6aa5198cc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:14.931693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 232/455] 10.222.0.57 () {56 vars in 1376 bytes} [Wed Sep 7 12:59:14 2022] GET /identity/v3/role_assignments?group.id=c95a1639127e4c7cbd10c26ba170a8f3&scope.project.id=07da914e24704120962aa1acd6dda617&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:17.575259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514fab-94a0-42e7-ad9e-8186841d7b2f None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:17.576874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514fab-94a0-42e7-ad9e-8186841d7b2f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:17.577350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514fab-94a0-42e7-ad9e-8186841d7b2f None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:17.579140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 224/456] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:17.589574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3bf8-b274-4bb7-88e0-ad0bd0bbc8ec None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:17.590435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3bf8-b274-4bb7-88e0-ad0bd0bbc8ec None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:17.590945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a3bf8-b274-4bb7-88e0-ad0bd0bbc8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:17.621044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-971a3bf8-b274-4bb7-88e0-ad0bd0bbc8ec None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:17.622570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-971a3bf8-b274-4bb7-88e0-ad0bd0bbc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:17.649907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:17.717658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 233/457] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:17.876486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4a20-0a3e-4686-8070-53b77c979bf2 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:17.877187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4a20-0a3e-4686-8070-53b77c979bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:17.877682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e4a20-0a3e-4686-8070-53b77c979bf2 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:17.879470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 225/458] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:17.884613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:17.884899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:17.885173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:17.908799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:17.909977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:17.953583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b3a9-4f9b-4213-b7a7-b037a9affc42 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:17.954222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b3a9-4f9b-4213-b7a7-b037a9affc42 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:17.954683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254b3a9-4f9b-4213-b7a7-b037a9affc42 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:17.956627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 226/459] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:17.962060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c35a-d735-435c-9c33-6d1167271868 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:17.962567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c35a-d735-435c-9c33-6d1167271868 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:17.963047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c35a-d735-435c-9c33-6d1167271868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:17.993831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 234/460] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:18.005400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d3c7c35a-d735-435c-9c33-6d1167271868 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:18.006593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d3c7c35a-d735-435c-9c33-6d1167271868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:18.107690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.108388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 227/461] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:18.274747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:18.289380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843c19f-3ee3-471d-9dc5-d0b78d83de28 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:18.305855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a068-1bdf-44df-9d54-df9f4122e253 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.306342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a068-1bdf-44df-9d54-df9f4122e253 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.306747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a068-1bdf-44df-9d54-df9f4122e253 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.308515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 228/462] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:18.321157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.321604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.322028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.330063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:18.330693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.330968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.331234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.341420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:18.342861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:18.358332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:18.359450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:18.360579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:18.360579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:18.360579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:18.361044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:18.362224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:18.362541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 235/463] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:18.374085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.464119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 229/464] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:18.464119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.500417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b2da4-e65f-496f-88d2-9301ee92e380 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:18.513242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:18.550748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:18.552234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.552974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.553392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.554433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:18.555764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:18.557318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:18.573693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 236/465] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:18.574862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.580358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:18.590151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564912ba-01f4-4175-a6d4-ea58e0df4e9a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:18.636908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:18.638897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.639330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.639766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.658620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:18.660405 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:18.679112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:18.680023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:18.680888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:18.680888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:18.680888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:18.688471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 230/466] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:18.689717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.696210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f14c26-af0f-4c04-92f4-291488626383 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:18.736878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:18.737523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.737801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.738073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.749917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:18.751395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:18.766854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:18.768162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:18.769664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:18.769664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:18.769664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:18.772322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 237/467] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:18.774279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.794908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:18.804155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244e50e-8ee1-4aff-9e91-b711da5f89aa None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:18.840302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:18.840914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.841216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.841485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.842165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:18.843604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:18.848391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:18.893882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a819e9-5cb9-4cc5-8574-0c6537bcf59f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:18.927033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:18.927635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:18.927909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:18.928209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:18.928844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:18.929144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:18.930512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:18.942852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 238/468] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:18.943731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:18.948268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 231/469] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:59:18 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:18.949253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:19.087713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa81ecf-377c-49f9-9ad1-3f602b82318a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:19.104261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2948eef-7e48-4fbc-a665-bb28a4c4126d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:19.105810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:19.134981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:19.136070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.136535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.137045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.146293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:19.147858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.148159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.148431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.149074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:19.149421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:19.150325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:19.150812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:19.151751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:19.167622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:19.168591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:19.170003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:19.170003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:19.170003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:19.170003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 239/470] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:19.170645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:19.171920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 232/471] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:19.175234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:19.188865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:19.288412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a7546-4e4d-4d8b-89f7-3c9bf3a81822 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:19.293265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a92029-626f-487b-bf98-8de52b0a0196 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:19.324034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:19.324667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.324947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.325218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.325886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:19.326186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:19.327575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75692af7-efbe-4abd-a61e-6b52aeac0c29 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:19.330141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:19.330758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.331031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.331294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.331934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:19.333357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:19.339613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 233/472] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:19.342338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25f41-0aad-49ef-95b6-13b734626899 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.343390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25f41-0aad-49ef-95b6-13b734626899 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.344432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25f41-0aad-49ef-95b6-13b734626899 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.346265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 234/473] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:19.347087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25f41-0aad-49ef-95b6-13b734626899 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:19.414351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:19.444710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 240/474] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:59:19 2022] POST /identity/v3/users => generated 248 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:19.445558 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:19.457584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25f41-0aad-49ef-95b6-13b734626899 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:19.486870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:19.501516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b75741-399b-4639-ac64-009b0be1ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:19.502133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75741-399b-4639-ac64-009b0be1ce22 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.502406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75741-399b-4639-ac64-009b0be1ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.502697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b75741-399b-4639-ac64-009b0be1ce22 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.503346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b75741-399b-4639-ac64-009b0be1ce22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:19.504852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b75741-399b-4639-ac64-009b0be1ce22 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:19.579146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5719ac-54c5-433e-ad2c-da7d930a465f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:19.617494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:19.618150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.618432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.618703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.619433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:19.620935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:19.623842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 235/475] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:59:19 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:19.625623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:19.625963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:19.629248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:19.654609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:19.655871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:19.726687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 241/476] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:59:19 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:19.750761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 236/477] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:20.048241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:20.155543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:20.183070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc49105-7f25-4ded-b65f-4bfb3b1bc581 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:20.232197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:20.232807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:20.233086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:20.233358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:20.234019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:20.235390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:20.278618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.sql.core [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:59:20.278618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 12:59:20.278618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [parameters: {'id': '9d8b4d60abd241868072ea56385f831b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 12:59:20.278618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81819) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result.read() Sep 07 12:59:20.305640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return ref.to_dict() Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:59:20.306522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application yield resource Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application next(self.gen) Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise self.value Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application session.commit() Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 12:59:20.307483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.session.flush() Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application compat.raise_( Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 12:59:20.308874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 12:59:20.310347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application conn.query(q) Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application result.read() Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 12:59:20.311159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [parameters: {'id': '9d8b4d60abd241868072ea56385f831b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:20.311935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 07 12:59:20.312777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:20.313680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 242/478] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 7 12:59:20 2022] POST /identity/v3/roles => generated 144 bytes in 259 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:20.313753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:20.406733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:20.468861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04952061-5960-44a7-b537-c5d7d7650451 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:20.520572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead893db-c086-48a9-b26e-9142571d0c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:20.521208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead893db-c086-48a9-b26e-9142571d0c74 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:20.521482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead893db-c086-48a9-b26e-9142571d0c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:20.521752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead893db-c086-48a9-b26e-9142571d0c74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:20.540193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead893db-c086-48a9-b26e-9142571d0c74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-ead893db-c086-48a9-b26e-9142571d0c74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:20.545700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:20.547870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:20.559200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 237/479] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 12:59:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:20.560791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:20.679729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bd2b6-19dd-4d00-bbee-b89e66d99dbd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:20.725389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:20.726003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:20.726278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:20.726547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:20.727318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:20.727850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:20.729079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac4cd6-8ff7-44d5-894f-90aacb1cf52b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:20.740110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 243/480] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:21.519824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c338-a6c9-4982-b273-912b846a1295 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:21.520358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c338-a6c9-4982-b273-912b846a1295 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:21.520455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69c338-a6c9-4982-b273-912b846a1295 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:21.522561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 238/481] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:21.528123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:21.528435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:21.529316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:21.537847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:21.553215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:21.554536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:21.642136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 244/482] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:21.980261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c338-a6c9-4982-b273-912b846a1295 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:22.088311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69c338-a6c9-4982-b273-912b846a1295 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:22.109384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:22.138244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43816fea-1ae4-4252-9877-509440212645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:22.138885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816fea-1ae4-4252-9877-509440212645 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.139158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816fea-1ae4-4252-9877-509440212645 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.139427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43816fea-1ae4-4252-9877-509440212645 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.154721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43816fea-1ae4-4252-9877-509440212645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-43816fea-1ae4-4252-9877-509440212645 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:22.159577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:22.160455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:22.161253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:22.164398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 239/483] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:22.166826 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:22.222812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7898-e846-414a-b225-987bb05f408d None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.223093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7898-e846-414a-b225-987bb05f408d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.223929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7898-e846-414a-b225-987bb05f408d None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.225322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 240/484] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:22.232382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3816-94dd-450b-aaa9-3dc74e60424b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.232514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3816-94dd-450b-aaa9-3dc74e60424b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.232823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e3816-94dd-450b-aaa9-3dc74e60424b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.266276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-934e3816-94dd-450b-aaa9-3dc74e60424b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:22.267773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-934e3816-94dd-450b-aaa9-3dc74e60424b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:22.305722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043b1e-926b-4f6c-9354-f3a242a179c4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:22.345005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:22.345700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.345981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.346249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.346911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:22.347209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:22.348604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:22.350030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:22.358762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 245/485] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:22.365060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:22.420570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 241/486] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:22.437472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7079-9ee3-4fd2-a3a7-b08b18feb9de None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.438057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7079-9ee3-4fd2-a3a7-b08b18feb9de None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.438530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d7079-9ee3-4fd2-a3a7-b08b18feb9de None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.440366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 242/487] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:22.456164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657680e-8ba5-466e-92f8-4a1a27b9d80b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.456523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657680e-8ba5-466e-92f8-4a1a27b9d80b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.456875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657680e-8ba5-466e-92f8-4a1a27b9d80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.490279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f657680e-8ba5-466e-92f8-4a1a27b9d80b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:22.491439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f657680e-8ba5-466e-92f8-4a1a27b9d80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:22.539561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efd381-a497-4b05-aa15-b318d9015c19 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:22.588912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:22.589571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.589825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.590091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.609247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:22.611095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:22.619076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 243/488] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:22.619632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f34ee-956e-442d-ae1f-a3b10bcdf377 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.619854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f34ee-956e-442d-ae1f-a3b10bcdf377 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.620160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f34ee-956e-442d-ae1f-a3b10bcdf377 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.623246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 244/489] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:22.627356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.627642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.630691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:22.638969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:22.639876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:22.640757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:22.640757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:22.640757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:22.652135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 246/490] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:22.657015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:22.658438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:22.663216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:22.697271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:22.738633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 245/491] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:22.739806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:22.776568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:22.886489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24618-b9fc-4d3c-a4e1-275c4eefd72a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:22.914647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295456a-36e2-4b30-b00e-a9ff152b3e57 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:22.954160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:22.955114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.955636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.956232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.957088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:22.957685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:22.959659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:22.960977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:22.961715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:22.961856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:22.962126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:22.973001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:22.974559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 247/492] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:22.975694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:22.977805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:22.978928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:22.979996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 246/493] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:22.984219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.011446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.086568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5218c0c-8c4c-4f32-9813-1cd895a9b485 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.086759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a0037-1378-450a-a0f3-c1329e009edf None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.096488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.122628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.122933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.123266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.123546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.123813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.124274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.124691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.124961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.132793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.134242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.139693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:23.145232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:23.146097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:23.146876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 248/494] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:23.148037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:23.149619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:23.150514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:23.151472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:23.155629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 247/495] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 12:59:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:23.157304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.246807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.262556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e888d2f-c653-43c3-a3e5-d4b56eee6c73 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.265384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e722b-b5d6-4a99-a606-b5b5ee8de33a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.299685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.300345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.300624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.300892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.304611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.305412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.305831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.306240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.307065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:23.307518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.309045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.311882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:23.316661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:23.317735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 248/496] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:23.318723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.326197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 249/497] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:23.329635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.360783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.425576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b1038-084b-49e9-9a3f-096f3d48405b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.431070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d0f0f-a7b0-40bd-a394-3dba254573e4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.462672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.463275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.463552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.463824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.464514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:23.464886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.466788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.466906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.467425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.467696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.467966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.468716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:23.469013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.470419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.480112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 249/498] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:23.480112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.490149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.514447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 250/499] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:23.515147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.588692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db64ac9-c03e-4534-a6ab-751455d7d3b2 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.608151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.622373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee9a9f0-6a60-4973-ba72-8b0e693b74b6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.623465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.624071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.624386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.624654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.625316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:23.625617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.627010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.640509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 250/500] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:23.640509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.666532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.667175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.667451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.667718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.678359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.679787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:23.695104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:23.695988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:23.696918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:23.696918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:23.696918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:23.696918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 251/501] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:23.697148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.707453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.742580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b53dd-c4db-4b13-ada3-619c6cbf0ce4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.777866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.778516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.778787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.779195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.790923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.792403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.798335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b0b55-abf8-49ce-bffc-15d27ad47c0c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:23.806657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:23.807623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:23.808878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:23.808878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:23.808878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:23.808878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 251/502] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:23.808878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:23.835399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.836003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.836323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.836598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.847397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.902990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.904904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.908681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c8620-38cb-47e9-9000-97424b68624e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:23.928313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:23.941787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:23.942409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.942682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.942950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.953678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:23.955116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-37b2be24-6092-479c-aaeb-27b49e188480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:23.969412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:23.970388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:23.971206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:23.971206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:23.971206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:23.971206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 252/503] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:23.972322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba464-0b71-4762-bd1b-9ea424de4f87 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:23.972802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba464-0b71-4762-bd1b-9ea424de4f87 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:23.973425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ba464-0b71-4762-bd1b-9ea424de4f87 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:23.974679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 253/504] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:23.975473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ba464-0b71-4762-bd1b-9ea424de4f87 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.006317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 252/505] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:24.007144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.048805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.076572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ba464-0b71-4762-bd1b-9ea424de4f87 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.105299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ed8e5-73db-410e-8865-3dd173e1c80a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.110239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.110836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.111115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.111388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.112027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:24.112359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.113742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.124725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 254/506] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:24.125523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.144007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.145068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.145342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.145611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.146252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:24.146554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.147928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d15956-776b-450c-8ba6-6379f78ae291 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.157182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.160156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 253/507] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:24.161309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.161593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.161864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.179807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:24.181056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:24.230556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bbb66-8ad4-49fa-b28f-8a0e99b94789 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.247503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 254/508] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:24.248361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.271208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.271897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.272204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.272491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.273115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:24.273415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.274806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.280289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.286326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 255/509] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:24.286951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.358400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9cadc-e362-421d-b6e4-e75134b012b1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.384196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.394501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1af5b2-cb8d-4668-867e-b2a86da52480 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.396159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.396989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.397260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.397527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.407912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.409336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:24.425888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:24.426775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:24.427622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:24.427622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:24.427622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:24.427622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 255/510] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:24.428451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.434601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.435297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.435576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.435847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.443096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.444635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:24.456909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:24.457997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 256/511] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:24.459091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.519533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.537254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4318a-2f9c-47c0-aa36-cc8553e998f2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.563122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a14bc-3a4d-4d67-9997-7c73bbb25e5b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.572726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.573367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.573655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.573973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.581160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.582598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:24.595706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:24.596630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:59:24.597526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:24.598178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.598178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.598178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.598384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 256/512] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:24.598464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.598541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.607985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.609462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:24.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:24.621635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 257/513] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:24.622768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.639164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.702601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2d665-bec4-40dc-856a-32c09b767bed None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.724549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42cc8e-41c5-4032-919a-49ac80abdc0a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.736816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.737423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.737711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.737974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.738612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:24.738911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.740346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.751781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:24.752691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.755234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.758502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.759120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.759436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.759700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.760445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:24.760742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.762161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.800915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:24.801864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.859407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158e205-ca32-4389-8f4b-9969822df427 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.867781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:24.891942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.892844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.893174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.893570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.897245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4790ccc-5467-47b3-96ef-cdf49c15c458 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:24.905509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.906941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:24.921244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:24.922264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:24.923242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:24.923242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:24.923242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:24.923242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 258/516] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:24.923242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.933652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:24.934259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:24.934532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:24.934889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:24.935612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:24.935910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:24.937369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:24.954376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 259/517] 10.222.0.57 () {56 vars in 1139 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:24.955271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:24.979148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.023396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c09e75-4de9-40c8-bc82-b2f4a8737990 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.055130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9996dd-d908-4ee4-bf50-ee58f4c56b20 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.059864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.060643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.060915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.061177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.061890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:25.062186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.063593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.081201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 259/518] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:25.081819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.086086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.090242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.091533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.091803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.097152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.099306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.100772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:25.112586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:25.113437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:25.114289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 260/519] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:25.114772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.185046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b00bc-421b-4f7e-a9d4-1ef330be41e7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.197897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.213633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61420d-2850-40cc-9e66-445aa1d00872 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.219484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.219610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.219846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.220143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.248253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.248847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.249117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.249378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.250001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:25.250293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.251662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.263592 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 261/520] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:25.264397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.291260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.292737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.314297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.366289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6fd9f-0d46-4d38-8a00-d10815dafa02 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.388327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 260/521] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:25.389136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.399158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.399896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.400268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.400599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.404982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.467001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.468395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.489042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf4c7-0f6e-445e-8a58-27f3b8b78d25 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.515099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.522277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.522881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.523187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.523467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.566505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 262/522] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:25.567419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.590650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.592640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.606287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.670070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b644683c-2851-45b2-bfc8-07839f1dbe0d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.695760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 261/523] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:25.696606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.703615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.704256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.704532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.704795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.705469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:25.705771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.707194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.724727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 263/524] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:25.725538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.736559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.799130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c41d-043d-45b3-ba15-34ec056a42f8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.811911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:25.824829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1fd66-b023-498f-81d7-98c68d3fd37f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:25.832931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.833528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.833799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.834065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.834693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.836300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.859358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:25.859984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:25.860291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:25.860562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:25.870435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:25.871885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:25.886200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:25.887204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:25.888623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:25.888623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:25.888623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:25.888623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 264/525] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:25.888843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.945111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 262/526] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:59:25 2022] POST /identity/v3/users => generated 247 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:25.945936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:25.961162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.007409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8dc1d-6a5e-4dd1-8fd8-738f38f054ef None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.048513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.049432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.049706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.049975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.060974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.062489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.070905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf06ff5-ae96-46f4-a5b5-d97d3e80d9a9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:26.078701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:26.079682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:26.080583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:26.080583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:26.080583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:26.084642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 265/527] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:26.086112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.115878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.116565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.116840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.117110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.129112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.130559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:26.145788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:26.146685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:26.147497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:26.147497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:26.147497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:26.147497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 263/528] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:26.148561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.175217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.208058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77129ed-41c6-4e62-a884-973520a47cdd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.222307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.243969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.244883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.245158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.245426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.246155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=08d7cfc07ef940b99652044bc7879601) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:26.246460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.248453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.260203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 266/529] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/role_assignments?user.id=08d7cfc07ef940b99652044bc7879601&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:26.260203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.266897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8278-1a96-40b2-82d3-d4cd0843236f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.315406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.316607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.316890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.317164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.318197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:26.318486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.320647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.338989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 264/530] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:26.339984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.370646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0d319-e3f8-4271-a0f2-0597f9ee0d9e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.409743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.410355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.410633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.410906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.411557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:26.411859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.413437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.427937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 267/531] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:26.428914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.453082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.475799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de73e7f-cba5-4609-b224-c7b529b5527b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.478039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.525253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.526161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.526585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.527010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.527824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:26.528294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.530434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.545572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 265/532] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:26.546343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.554979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577f6b-94e3-4b22-9bbc-c7e6242b6d5f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.600284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.601262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.601688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.602270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.611510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.613692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:26.626367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:26.627450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:26.628540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:26.629472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 268/533] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:26.630350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.666776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c5097-6ac0-4c09-a0f4-a396ac853ce9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.704408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.705338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.705857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.706311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.714015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.715676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:26.729568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:26.730625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:26.731703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:26.734085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 266/534] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:26.738626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.744610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.747623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:26.753828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21bfe2-63ae-402a-b8ac-433e682c8481 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.797055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.797620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.797895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.798165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.806506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.808073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:26.820945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:26.821834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:26.822663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:26.827294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 269/535] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:26.828900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.874855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1be06d-3d44-4997-ad0b-e7e37547fe96 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.914364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.915514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.915996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.916508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.917460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:26.918062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.919928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:26.940578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 267/536] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:26.941919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:26.945313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84ee3-33f5-4bc8-be29-14c3c630f4e4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:26.984362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:26.984972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:26.985246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:26.985517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:26.986201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:26.986501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:26.988041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:27.006685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 270/537] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:27.006685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:27.014694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:27.024009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:27.061353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc8811-1675-492e-8779-3386f0c725b4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:27.099991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:27.100769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:27.101147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:27.101519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:27.102417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:27.102839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:27.104492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:27.120137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 268/538] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:27.120137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:27.124847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cfeaf-c53e-4bc2-a9db-3029fbf21bfc None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:27.163888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:27.164523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:27.164797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:27.165061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:27.165893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=6b143093bf1e4625a24a2e26ce5ba8a8) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:27.166201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:27.167732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:27.174441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 271/539] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:27 2022] GET /identity/v3/role_assignments?user.id=6b143093bf1e4625a24a2e26ce5ba8a8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:27.175410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:27.234705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9d37-04ad-4dff-a785-099d29912ba4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:27.257963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:27.268774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:27.275753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:27.278973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:27.278973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:27.278973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:27.278973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=57192d85635c489997ea172156dc4695) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:27.278973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:27.280294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2a978-3e03-46b8-8a31-712b7e49de13 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:27.286944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 269/540] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:27 2022] GET /identity/v3/role_assignments?user.id=57192d85635c489997ea172156dc4695&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:27.291696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a5115-3a72-4c8b-905e-8cf341b30a56 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:27.331894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:27.332465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:27.332739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:27.333008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:27.333929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=50d240642e9246dbad42f8e379a60b21) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:27.334244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:27.336119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da400d13-5c78-4c00-96a5-a9873700b98c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:27.343274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 272/541] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:27 2022] GET /identity/v3/role_assignments?user.id=50d240642e9246dbad42f8e379a60b21&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:28.440729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694d38-f158-42a8-b41e-6ed3361a9bb1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:28.441364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694d38-f158-42a8-b41e-6ed3361a9bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:28.441364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694d38-f158-42a8-b41e-6ed3361a9bb1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:28.442905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 270/542] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:28.449042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d448-a763-4bbb-a9a6-7b5bd177b455 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:28.449707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d448-a763-4bbb-a9a6-7b5bd177b455 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:28.449707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199d448-a763-4bbb-a9a6-7b5bd177b455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:28.476661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5199d448-a763-4bbb-a9a6-7b5bd177b455 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:28.477864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5199d448-a763-4bbb-a9a6-7b5bd177b455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:28.600215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 273/543] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:29.026729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694d38-f158-42a8-b41e-6ed3361a9bb1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.030686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284835c-4348-4ff4-9bc8-650426ded2f0 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.030972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284835c-4348-4ff4-9bc8-650426ded2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.031244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284835c-4348-4ff4-9bc8-650426ded2f0 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.032930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 274/544] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:29.037867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.038148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.038425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.059172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:29.060453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:29.148257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 275/545] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:29.191482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694d38-f158-42a8-b41e-6ed3361a9bb1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:29.231678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:29.232334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.232607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.232873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.255010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:29.260135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:29.261010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:29.261800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 271/546] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:29.267778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.271645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:29.399243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618e1d7-3c74-45a1-bb4d-2c2521254813 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:29.434378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:29.435726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.435997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.436286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.436941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:29.437233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:29.438590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:29.447263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 276/547] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:29.453276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.456729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.531467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:29.564439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:29.596661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b223c34-3a4b-415d-a108-355b2d7111de None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:29.608277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd856eb8-7334-46b2-869f-c0c9eea72d28 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:29.648892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:29.649589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.649850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.650067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.661389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:29.663117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:29.678465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:29.679502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:29.680856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:29.680856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:29.680856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:29.680856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 272/548] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:29.686316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.699802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:29.701138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.701434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.701717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.728384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:29.735107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:29.737158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:29.739078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:29.744628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 277/549] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:29.744628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.837447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb123-a45f-48aa-9e35-dbb8e40002eb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:29.839028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:29.880358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:29.880989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:29.881264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:29.881533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:29.882188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:29.882492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:29.883912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:29.898731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 273/550] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:29.905322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:29.986189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f8caf-1800-4679-b286-80991d7e5a68 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.029474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.031971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a4da7-20ef-40cf-b672-e48ccbdb2aea None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.038280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.043564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.043564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.043564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.043564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:30.043564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.043564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a5084-eebe-4bf0-b1cb-96265ee9c90b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.050826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 278/551] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:30.052100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e1b67-ffcd-4ef6-895d-7ed46fc2c2db None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.052386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e1b67-ffcd-4ef6-895d-7ed46fc2c2db None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.052652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e1b67-ffcd-4ef6-895d-7ed46fc2c2db None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.055513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 279/552] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:30.056650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47da62-a97f-4471-a71d-229c7f4e8cfe None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.056912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47da62-a97f-4471-a71d-229c7f4e8cfe None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.057186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47da62-a97f-4471-a71d-229c7f4e8cfe None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.059822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 280/553] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:30.059822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc587fd-df4f-421a-82b0-9859b3241151 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.060506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc587fd-df4f-421a-82b0-9859b3241151 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.060925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc587fd-df4f-421a-82b0-9859b3241151 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.062306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 281/554] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:30.063177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc587fd-df4f-421a-82b0-9859b3241151 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.071968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.072635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.072905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.073171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.080979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.082416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-42b96e77-1c55-4a03-8b10-7d634575390f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:30.093675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:30.094583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:30.095592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 274/555] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:30.096210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad6871-4680-4c08-8682-c557cb605ce4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.096210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad6871-4680-4c08-8682-c557cb605ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.096369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad6871-4680-4c08-8682-c557cb605ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.114028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-efad6871-4680-4c08-8682-c557cb605ce4 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:30.115199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-efad6871-4680-4c08-8682-c557cb605ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:30.125648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.171064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc587fd-df4f-421a-82b0-9859b3241151 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.181890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 275/556] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:30.183115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.183426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.183695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.201887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:30.203080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:30.206068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.206697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.206974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.207240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.218671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.220150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-bb54fab3-7293-49fc-a986-8de50bd5dbfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:30.236641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:30.237559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:30.238517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:30.238517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:30.238517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:30.238517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 282/557] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:30.239257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.239257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.239501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.258831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:30.260264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:30.277490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 276/558] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:30.278164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.312966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.351520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 283/559] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:30.352825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.362319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.406331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b0095-2748-4946-aee0-c06909445cd8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.461848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c45ef2-d8cc-4c35-a51b-2e7255385183 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.472703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.473322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.473608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.473861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.474590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:30.474892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.476345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.496452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 277/560] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:30.498247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.503460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.504110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.504394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.504712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.505349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:30.505695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.507086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.519637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 284/561] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:30.524290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.554377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.626794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1c34b-5528-449f-a813-d113440428d6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.657009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6048c-e552-4279-902f-191b8e8bc59e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.668340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.669015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.669927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.670081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.692013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.692668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.692935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.693195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.694983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.703659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:30.708555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:30.709521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 278/562] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:30.710432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.740763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.742151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.770350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.810881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf50f1-20d3-49e1-971f-b1985a4e8f59 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.839706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 285/563] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:30.840578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.849003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.849635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.849905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.850170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.858478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:30.859909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:30.871283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:30.872845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 279/564] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:30.873780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:30.928168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.943248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b4c0e-88c5-46fc-8ad2-42c2417ebf45 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.971650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:30.972547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36206d1-600e-414d-94d8-62918907ce24 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:30.977548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:30.978172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:30.978444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:30.978708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:30.989853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:30.994784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:30.995715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 286/565] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:30.997098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.010455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.011082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.011354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.011621 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.021805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:31.027031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:31.032455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 280/566] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:31.033458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.100571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4806b4f-a533-4945-a439-329f0034c719 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.129925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91109f2-ec47-4693-8099-dd8543dd1598 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.134912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.135505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.135776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.136040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.136717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:31.137010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.138484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.143751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.146945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 287/567] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:31.147728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.163800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.164461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.164737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.165001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.175824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.177588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:31.193200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:31.194297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:31.195192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:31.195192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.195192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:31.195192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 281/568] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:31.195643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.206896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.254346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398988af-ac62-4351-9c01-f1c839b4e3bc None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.286836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.287440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.287715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.287980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.288716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:31.289013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.290423 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.294427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7b661-bd39-4fe5-a1f3-1e571c5e6bd9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.307438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 288/569] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:31.308267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.327918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.328557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.328833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.329102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.329759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:31.330061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.331412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.339623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 282/570] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:31.340376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.368793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.408375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb0799-54b7-4e14-b234-fd3dbdc9d34c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.419516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.439410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f09a7-0b06-428c-9edd-e52120823181 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.442110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.442708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.442984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.443263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.444200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:31.444740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.446445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.458681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 289/571] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:31.458681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.474802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.475436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.475708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.475974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.486244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.487679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:31.502880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:31.503895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:31.504874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:31.504874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.504874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:31.504874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 283/572] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:31.504874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.559378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc497a-2701-434a-95d6-2ef0f1c56ed6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.587499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.593013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.593611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.593890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.594162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.594799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:31.595101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.596512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.605720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76439a9-bf10-4138-9722-d254ef111d3b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.608337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 290/573] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:31.609163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.639569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.645936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.646576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.646848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.647113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.659597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.661058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:31.675771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:31.676814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:31.677726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:31.677726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.677726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:31.677726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 284/574] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:31.677726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.712540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f5ccf-3571-4a77-b3d5-d910dc466c14 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.746545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.747212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.747488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.747761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.757852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.759267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:31.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:31.775447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:31.776390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:31.776390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.776390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:31.776390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 291/575] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:31.776390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.783002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14981e-b272-49e4-ab10-d9f5cb2fda9b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.811284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.816058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.816699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.816967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.817229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.827838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.829707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:31.845016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:31.850900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:31.852064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:31.852064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:31.852064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:31.852064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 285/576] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:31.852064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.861477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:31.876590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1904e-21bc-4291-bd17-11dc2dd3ec45 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.917321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.917920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.918191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.918459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.919166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:31.919464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.920919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:31.932019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 292/577] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:31.932663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:31.949221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd699ca2-bacf-4d14-b31f-4ba9d21793c2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:31.983070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:31.983701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:31.983985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:31.984297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:31.991085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:31.992561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:32.003703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:32.004780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 286/578] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:32.005859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.040113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e87ad-e809-41e9-812e-ccce4dddc825 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.052483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.072718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.073316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.073590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.073854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.074483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.074780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.076833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.088946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 293/579] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.089566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.098076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.112411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8966f-f54b-4086-a973-d57a2d961bc7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.147174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.147926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.148330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.148695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.149396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.149767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.151133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.162925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 287/580] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.163788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.192167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c163-3e34-45a4-bfe2-2ecb89a03ee7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.226891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.227495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.227767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.228038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.228714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.229020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.230385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.246501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 294/581] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.247562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.267016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70771093-0ad0-48c7-af9e-955b26652463 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.269633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.306528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.307082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.307355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.307622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.312767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.314746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.316214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:32.327512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:32.328675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 288/582] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:32.329858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.353459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bcd33-6fff-4272-8514-8c66af3e7062 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.388524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.389111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.389387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.389655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.390341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.390642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.392066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.405090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 295/583] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.405887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.429181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b48b3-9de1-4519-bad1-f4a638464cc4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.461788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.462415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.462699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.462962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.470090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.471517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:32.483690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:32.485044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 289/584] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:32.485949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.507617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0c56c-c080-43b7-9063-739a38bb37c1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.510216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.532015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.542051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.542675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.542950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.543217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.550145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.551586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:32.562949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:32.564436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 296/585] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:32.565361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.592001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea72d21-3432-4806-b03a-579e15633179 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.629105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.629728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.630004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.630271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.637130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.639186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:32.651687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:32.652868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 290/586] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:32.654666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.672493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166e648-8915-48b4-ab60-6df29cd3aac3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.705593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.706194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.706469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.706741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.707456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.707759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.709224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.726406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 297/587] 10.222.0.57 () {56 vars in 1139 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.727206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.740489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.755994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f20c9a-9b7c-4687-88aa-7284e97a9efa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.772349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:32.789999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.790597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.790870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.791137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.791889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=0b772e6cbf5f4fecbc91fc058ff29dc8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.792220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.793627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.799710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 291/588] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/role_assignments?user.id=0b772e6cbf5f4fecbc91fc058ff29dc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.800366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.839245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae3f31-6486-4137-9af9-e9a024341c55 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.878179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.879475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.879475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.879776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.880635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.881006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.882697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.897999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 298/589] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.898983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.922746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290d07-37a4-4823-b8bb-b741cefb5480 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:32.960772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:32.961396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:32.961669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:32.961940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:32.962676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:32.962973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:32.964458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:32.987849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 292/590] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:32.987849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:32.994396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.015889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3454ed-64be-4cd1-b52a-1518ca37f5f6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.017715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.054279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.054891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.055171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.055442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.056194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:33.056499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.057924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.080355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 299/591] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:33.080355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.103785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f7d76-2cc1-4158-901b-1e6c0a048848 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.144037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.145524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.146073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.146353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.158192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.160072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:33.180372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:33.181804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:33.183047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:33.183047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:33.183047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:33.183047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 293/592] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:33.184338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.189608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc85ae-5d96-4418-82c6-de2a1dc33af0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.226898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.227699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.228045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.228395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/08d7cfc07ef940b99652044bc7879601/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.244491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=08d7cfc07ef940b99652044bc7879601, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.246004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.247231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.290243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b66ac-1368-4c75-b2af-e8e2dcde7faa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.319242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 300/593] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:33 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/08d7cfc07ef940b99652044bc7879601/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:33.320349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.331894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.333911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.334362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.334785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.352451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.354783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.368507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:33.376237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:33.377427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:33.378526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:33.378526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:33.378526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:33.386180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 294/594] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:33.388261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.471510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a42af-a4b2-406d-8712-cf01f58eb065 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.524494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.525346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.525628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.525905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.526513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ca60d-891a-48d0-8351-ebc5f40b37a7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.539455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.540062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.541784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:33.557434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:33.558417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:33.559310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:33.559310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:33.559310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:33.560379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 301/595] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:33.561064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.572584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.573293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.573640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.573984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.575709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:33.575709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.577138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.591103 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 295/596] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:33.592136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.647097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.701870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c382c0-bf46-4414-9522-b6d0d8b71acd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.725084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce5603-5527-4c7b-9fc2-743c503ae875 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.739001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.739448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.739798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.740164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.741044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:33.741547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.742864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.761528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 302/597] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:33.762511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.771573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.772485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.772973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.773420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.774264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:33.775263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.777292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.793754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 296/598] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:33.795470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.838017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.876763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb85b8-0541-49d5-a21d-11524e7437d2 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.906425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:33.920188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.921112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.921397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.924623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.930790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.932624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:33.933700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96801d9f-0abd-443f-bc36-adb3cd6c8318 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:33.947891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:33.949052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:33.950045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 303/599] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:33.951087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:33.983680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:33.984756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:33.985136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:33.985746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:33.995452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:33.998834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:34.013739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:34.014831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 297/600] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:34.016714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.081074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d3da-53ef-4d90-8388-58ddcfec2fc3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.118668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.119416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.119696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.120067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.123965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:34.129212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.130893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.133554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1378f-b617-45bc-8f40-b609c363b65c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:34.143314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:34.144486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:34.145531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:34.147430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 304/601] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:34.148379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.176579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.177126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.177401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.177658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.178345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:34.178863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.180051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.197142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 298/602] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:34.197142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.204767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:34.291294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe352e9-87d9-41dc-acbc-0f4a266c89af None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.334005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.334688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.334881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.335154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.335841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:34.336186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.337630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.338242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83721b42-aa41-4a02-9ba5-b9c4c19ba8f6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.351627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 305/603] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:34.352542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.384166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.385415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.386079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.386495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.387328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:34.388543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.389977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.408177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 299/604] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:34.409053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.421835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:34.482504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947e415-4b83-44bc-b96d-67b7266aa9e6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.484834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:34.516778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cba118-549a-424f-9bee-f98d3afc92fd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.529151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.529842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.530123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.530397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/57192d85635c489997ea172156dc4695/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.555435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=57192d85635c489997ea172156dc4695, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.557834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.569178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168b80c-67aa-4b10-8872-e23e5e212372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.569847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b80c-67aa-4b10-8872-e23e5e212372 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.570122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b80c-67aa-4b10-8872-e23e5e212372 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.570393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168b80c-67aa-4b10-8872-e23e5e212372 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/6b143093bf1e4625a24a2e26ce5ba8a8/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.586338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168b80c-67aa-4b10-8872-e23e5e212372 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=6b143093bf1e4625a24a2e26ce5ba8a8, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.588668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168b80c-67aa-4b10-8872-e23e5e212372 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.627093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 306/605] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:34 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/57192d85635c489997ea172156dc4695/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:34.628451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:34.708352 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 300/606] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:34 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/6b143093bf1e4625a24a2e26ce5ba8a8/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:34.763618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6cae84-70a2-4ff6-b13a-8a155ab879c3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:34.805282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fc44c-e4b7-4a9c-995e-c20e1d83c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:34.806039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fc44c-e4b7-4a9c-995e-c20e1d83c7f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:34.806318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fc44c-e4b7-4a9c-995e-c20e1d83c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:34.806589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fc44c-e4b7-4a9c-995e-c20e1d83c7f1 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/50d240642e9246dbad42f8e379a60b21/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:34.823618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fc44c-e4b7-4a9c-995e-c20e1d83c7f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=50d240642e9246dbad42f8e379a60b21, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:34.825691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fc44c-e4b7-4a9c-995e-c20e1d83c7f1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:34.916291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 307/607] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:34 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/50d240642e9246dbad42f8e379a60b21/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:35.013808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c030b-6216-42b8-8270-55209ec4ed22 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.013994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c030b-6216-42b8-8270-55209ec4ed22 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.014260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c030b-6216-42b8-8270-55209ec4ed22 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.015943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 301/608] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:35.021714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.022003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.022263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.029189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:35.045582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:35.046805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:35.146184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 308/609] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:35.426853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c030b-6216-42b8-8270-55209ec4ed22 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:35.507821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:35.569721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c030b-6216-42b8-8270-55209ec4ed22 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:35.614686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4d321-1181-4d49-8dcb-e080e16035b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:35.615698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4d321-1181-4d49-8dcb-e080e16035b8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.616216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4d321-1181-4d49-8dcb-e080e16035b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.616684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4d321-1181-4d49-8dcb-e080e16035b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.634792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4d321-1181-4d49-8dcb-e080e16035b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c9b4d321-1181-4d49-8dcb-e080e16035b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:35.640015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:35.641106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:35.642127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:35.644686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 302/610] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:35.650820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:35.789180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f90eb-347e-4128-a4a8-8f420a5cd968 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:35.797559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0a8-a9b3-40fa-92db-a8bc1325e021 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.798163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0a8-a9b3-40fa-92db-a8bc1325e021 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.798720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8a0a8-a9b3-40fa-92db-a8bc1325e021 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.800538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 303/611] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:35.806040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.806552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.807025 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.826341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:35.827882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:35.833937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:35.839496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:35.840124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:35.840404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:35.840670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:35.841934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:35.842233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:35.843703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:35.860139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 309/612] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:35.865282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:35.905929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 304/613] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:36.059238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc6391-2172-4c77-9110-027c2e20e24f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.109375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.110001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.110272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.110537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.131533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:36.133001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:36.151621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:36.152633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:36.154094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:36.154094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:36.154094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:36.154094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 310/614] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:36.159249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.263901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.293923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.355243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.394527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f321cc-a578-4fe4-bff8-d6de4f35f03b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.408572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6632f-1cb4-4175-98e5-e2b523cbb588 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.447203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.447841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.448141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.448558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.460360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:36.465629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:36.467325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:36.468607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 311/615] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:36.473370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.477051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.477700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.478031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.478311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.478980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:36.479285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:36.480718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:36.506379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 305/616] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:36.511895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.583994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c350334-09a6-4507-b82f-ba49eb43aa8e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.592425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.621700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.622846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.623121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.623389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.624051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:36.624801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:36.626244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:36.635791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 312/617] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:36.641917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.714865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c037f1-6e23-49cb-ac01-4afbed74f9ee None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.736609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:36.760437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.761093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.761375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.761647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.763058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b70f26-4aff-4076-8916-6858157319e0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:36.780230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:36.781897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:36.802731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:36.803719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:36.804842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:36.808011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 306/618] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:36.813858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.814616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:36.818073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:36.819364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:36.819865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:36.839453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:36.842683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:36.869312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:36.870299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:36.871193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:36.871193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:36.871193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:36.877772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 313/619] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:36.884734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:36.928445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.000176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece37ce2-d258-4447-be24-4eecd9e18c34 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.045517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.046128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.046404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.046671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.047397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:37.047698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.049291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.069328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 307/620] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:37.077912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.102645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042b99c-fd8f-46df-8fe1-afa33702696a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.139563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.178202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.178202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.178521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.178775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.179369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:37.179834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.181251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.208796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 314/621] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:37.214469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.263205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc4f51-b325-4ed2-b0f2-a4d11c424d7f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.306323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.307463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.307964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.308512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.320306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.322262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.324673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-10a7feec-8a94-48b7-bcca-261c2a37c1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:37.340192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:37.343234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:37.344278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:37.344278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:37.344278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:37.347711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 308/622] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:37.349311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f0e5-97e7-44dd-86f9-f7e74a0e0335 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.349647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f0e5-97e7-44dd-86f9-f7e74a0e0335 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.349928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079f0e5-97e7-44dd-86f9-f7e74a0e0335 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.355528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 309/623] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:37.355528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079f0e5-97e7-44dd-86f9-f7e74a0e0335 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.356928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a2621-9bb7-472a-9feb-d7837199a1c6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.406461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.407445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.407951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.408451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.416641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.418345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-bd71e747-7f92-4756-8cac-dd7224dee309 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:37.432837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:37.433829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:37.434823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:37.437502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 315/624] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:37.439004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.439506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.439976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.453279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.461781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:37.467417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:37.477855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079f0e5-97e7-44dd-86f9-f7e74a0e0335 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.515686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.516386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.516713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.516994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.517966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:37.518278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.519704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.538257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 310/625] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:37.539004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.552661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 316/626] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:37.554767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.638197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.677021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e138789-bc9a-4356-a3c3-67d6440d3e18 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.687265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0542-4b62-4a33-a9c3-7261ce57b830 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.717050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.717642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.718036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.718314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.722940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.723548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.723824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.724261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.725087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.725190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:37.725413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.726520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.726882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a617d4f-c4b6-4b5e-a8b1-b2a79d5a203a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.736450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a78f2b8e-73cd-489b-aa22-59378ee474e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:37.738811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:37.739684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:37.740682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:37.744418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 317/627] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:37.745807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 311/628] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:37.746178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb3f8-2e01-421e-9b60-f75e4c66393c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.746613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb3f8-2e01-421e-9b60-f75e4c66393c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.747088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cb3f8-2e01-421e-9b60-f75e4c66393c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.747211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702ef9c-a344-4310-b1a0-8d2b7e25b89e None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.747386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702ef9c-a344-4310-b1a0-8d2b7e25b89e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.747661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702ef9c-a344-4310-b1a0-8d2b7e25b89e None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.752982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 318/629] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:37.753334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 312/630] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:37.753449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb3f8-2e01-421e-9b60-f75e4c66393c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.754056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702ef9c-a344-4310-b1a0-8d2b7e25b89e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:37.861481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702ef9c-a344-4310-b1a0-8d2b7e25b89e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.868153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cb3f8-2e01-421e-9b60-f75e4c66393c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:37.895963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.896591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.896866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.897133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.897235 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.902905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:37.903521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.903810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.904105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.904840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:37.905139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.906552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ad06-f0dd-4b85-84bb-ad1a7899886d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:37.917971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 319/631] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:37.919616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3d6b-612a-4774-b7b3-e0c9cc6a2647 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:37.919889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3d6b-612a-4774-b7b3-e0c9cc6a2647 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:37.920182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b3d6b-612a-4774-b7b3-e0c9cc6a2647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:37.937645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-009b3d6b-612a-4774-b7b3-e0c9cc6a2647 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:37.938813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-009b3d6b-612a-4774-b7b3-e0c9cc6a2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:37.961544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:37.964827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:37.966303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.002626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 320/632] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:38.003847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.004157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.004426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.030997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:38.032214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:38.063073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 313/633] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:38.063904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.112265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 321/634] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:38.112265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.178617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.180001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.184541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d200053-ea54-4b19-a8c9-9498da437e22 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.228837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.230075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.230764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.231218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.239625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80630a92-8232-4fd7-bc8d-9fe0338bc283 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.248584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:38.253751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:38.254915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:38.255964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:38.262567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 314/635] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:38.263570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.284763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.285260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.285530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/0b772e6cbf5f4fecbc91fc058ff29dc8/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.301324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=0b772e6cbf5f4fecbc91fc058ff29dc8, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.302793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.372496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafeb9b7-76d5-43c8-8c85-2303b7f139c7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.381040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 322/636] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:38 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/0b772e6cbf5f4fecbc91fc058ff29dc8/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:38.382362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.422344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.422991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.423438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.423649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.436779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.438148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:38.454529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:38.455639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:38.456596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:38.456596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:38.456596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:38.456596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 315/637] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:38.456596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.470359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.502597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.507568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cf0fc-fcd9-479d-bb31-693abca86f06 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.547965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.548612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.548888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.549160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.549834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:38.550146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.551583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.562276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 323/638] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:38.562727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.572758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2ad5c-5da8-4428-9c8d-59dee3d194a0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.617212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.618121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.618398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.618668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.631643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:38.636891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:38.638000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 316/639] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:38.638949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.681040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88b0d0-7af7-465f-b645-2f38ebb8969f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.715894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.716475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.716745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.717009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.719114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.728335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:38.734092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:38.735320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:38.736201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 324/640] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:38.736928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.760175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aeb5cb-309c-4c3d-9a82-812c93cc4e41 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.763852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.796184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.796939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.797285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.797516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.798143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:38.798437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.799786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.817349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 317/641] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:38.817349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.851070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3948a3-9d38-46c4-b5d3-6e1eb2546334 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.889021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.889763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.890042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.890309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.901092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.902553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:38.919514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:38.920580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:38.921478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:38.921478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:38.921478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:38.921478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 325/642] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:38.921478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:38.928926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3140fb9-abb8-4281-8647-062f409b084b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:38.960221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:38.966766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:38.967381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:38.967659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:38.967932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:38.968680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:38.968977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:38.972774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:38.978419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 318/643] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:38.979213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.011371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.038529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ef7f1-b390-412d-a56b-b70971b26de7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.075034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.075695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.076002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.076249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.076925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.077252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.078572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.087185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620eaf8-39fb-4f91-8bc3-0fa7f1060d9a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.092415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 326/644] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.093511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.126933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.127831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.128124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.128404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.136799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.139479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:39.151824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:39.152785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 319/645] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:39.153898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.203248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdfda5-286a-4b2b-a861-6678f51af8ab None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.212689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.239328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.239869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.240173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.240450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.241090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.241394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.242774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.245479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.260836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 327/646] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.260836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.272608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60611d0c-a4e1-406b-9c66-6b723d2b5bac None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.310946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.311578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.311857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.312154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.323324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.324781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:39.339396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:39.340386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:39.341351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:39.341351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:39.341351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:39.341351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 320/647] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:39.342363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.367617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5d82-1c0b-4d05-a59d-f275fd686bed None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.404641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.405261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.405537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.405994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.416516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.417953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:39.433118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:39.434256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:39.435542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:39.435542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:39.435542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:39.438933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 328/648] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:39.439537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.447855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d13979-37bd-4c4a-a780-47d83aca9429 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.451822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.485460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.486382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.486662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.487104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.487765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.488072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.495955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.496219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.507486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 321/649] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.507486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.552900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6eca1-effc-4c2d-a6d0-9092ac0b14e4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.588259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.588891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.589166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.589433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.597901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.599347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:39.610489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:39.611649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 07 12:59:39.612834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:39.613876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1416c-fac9-4c1c-9d93-54f46bda4fea None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.616357 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 329/650] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:39.617201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.656495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.657211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.657599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.657895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.658646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.659066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.663406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.673468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 322/651] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.674320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.702840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.732639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cad6b-41b4-429e-8e39-f911d6447c4c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.741533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:39.767533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.768364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.768639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.768904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.769539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.769838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.771405 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.784130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 330/652] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.785069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.793141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8166c0-b1d9-4f9e-9eaa-8338fc9c0adf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.896862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910ea8-195d-4cb5-80fe-8c837e50a574 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:39.936393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.936996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.937272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.937542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.938255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.938557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.940050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.940315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:39.940920 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:39.941193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:39.941458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:39.942179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=08d7cfc07ef940b99652044bc7879601) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:39.942481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:39.943878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:39.949970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 323/653] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/role_assignments?user.id=08d7cfc07ef940b99652044bc7879601&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.950805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:39.982369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 331/654] 10.222.0.57 () {56 vars in 1139 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:39.983409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.014027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.086388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.099845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044da3b-ba73-4b82-b242-a6dfa0c623a4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.104138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3ae8f-abf5-4887-b93e-f111c2a5daf1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.141904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.143368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.143806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.144253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.150944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.151731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.152177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.152544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.154207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.156397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.165105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.166756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:40.171102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:40.172262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 332/655] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:40.173238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:40.185672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:40.186687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 12:59:40.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:40.188257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 324/656] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:40.188820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.280414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.297579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24bb6c-e983-479e-9029-4e7ee8331a33 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.314529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a20281-83d1-484c-bb08-2c76131f3e06 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.344734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.345365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.345647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.346174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.353683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.354290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.354555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.354819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.355543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:40.355838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.357307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.375766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 325/657] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:40.376646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.385121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.421061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.422562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.483291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30225780-0813-4d84-98c2-4fba6a0d9efe None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.519939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.520647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.520917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.521179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.521828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.521974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:40.522182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.523654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.539886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 333/658] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:40.541053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.544493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 326/659] 10.222.0.57 () {56 vars in 1137 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:40.546169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.611690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.654340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4deb2-7061-4232-8ad0-ddf71c6e64fd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.654773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96c3f9-3828-4752-a6c4-02d3e8bdf5ad None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.691853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec330d9f-3bfb-4040-81e6-5365f2bb0331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.692494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330d9f-3bfb-4040-81e6-5365f2bb0331 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.692772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330d9f-3bfb-4040-81e6-5365f2bb0331 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.693042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec330d9f-3bfb-4040-81e6-5365f2bb0331 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.693143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.693745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.694019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.694284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.707145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.708620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:40.722985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:40.724203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:40.725272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:40.725272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:40.725272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:40.725272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 327/660] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:40.725272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.758223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.772371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330d9f-3bfb-4040-81e6-5365f2bb0331 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.774667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec330d9f-3bfb-4040-81e6-5365f2bb0331 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.830821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871704b6-8d94-4a3c-88c9-633896cbef9d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:40.847752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.865656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f70cf-bf3f-4bde-8e51-b365dcc8a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:40.866200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f70cf-bf3f-4bde-8e51-b365dcc8a31d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.866478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f70cf-bf3f-4bde-8e51-b365dcc8a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.866747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f70cf-bf3f-4bde-8e51-b365dcc8a31d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.880231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 334/661] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:40.881600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2941-b909-46db-a0cd-61fc37b388b1 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:40.881881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2941-b909-46db-a0cd-61fc37b388b1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:40.882155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d2941-b909-46db-a0cd-61fc37b388b1 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:40.887480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 335/662] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:40.887480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2941-b909-46db-a0cd-61fc37b388b1 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:40.948663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f70cf-bf3f-4bde-8e51-b365dcc8a31d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:40.950863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f70cf-bf3f-4bde-8e51-b365dcc8a31d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:40.976867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:40.994146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d2941-b909-46db-a0cd-61fc37b388b1 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.029438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.030059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.030330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.030595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.031242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:41.031539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.033228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.046272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 336/663] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:41.047133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.064169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 328/664] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:41.065461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.065748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.066020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.083994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:41.085252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:41.096817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.160422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 329/665] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:41.160422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.166251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4994f-0a16-4125-8f0b-5d82b902df41 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.203407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.204054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.205213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.205496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.220443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.221530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.232183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:41.244248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:41.251977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:41.252941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:41.252941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:41.252941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:41.252941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 337/666] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:41.252941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.295498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2391d9-4d0b-49a0-9c3b-b381acf0cdef None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.335569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.336268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.336546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.336820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.346779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.348262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.362798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c74b0f-f2bb-4cc2-87ca-27d185c8c92f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:41.363922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:41.364951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:41.365838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 330/667] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:41.366345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.380253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.403468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.404112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.404433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.404656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.415815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.417498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:41.432307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:41.433471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:41.435012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:41.435012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:41.435012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:41.436790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 338/668] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:41.437817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.482089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6ceac-ef07-47c1-88f9-c3d55c14212b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.489412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.516774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11800248-08cc-473b-9156-7015961bad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.517381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11800248-08cc-473b-9156-7015961bad03 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.517893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11800248-08cc-473b-9156-7015961bad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.518168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11800248-08cc-473b-9156-7015961bad03 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.518794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11800248-08cc-473b-9156-7015961bad03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:41.519091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11800248-08cc-473b-9156-7015961bad03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.520475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11800248-08cc-473b-9156-7015961bad03 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.535251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 331/669] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:41.536823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11800248-08cc-473b-9156-7015961bad03 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.549890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a3e79-5ab5-4b39-8165-03f4565bd9ce None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.587109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.587947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.588362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.588800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.589595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:41.589953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.591505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.608962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 339/670] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:41.608962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.614513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.651483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11800248-08cc-473b-9156-7015961bad03 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.688769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.689404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.689761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.690034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.690754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:41.691121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.692606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.704677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 332/671] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:41.705493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.731893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410f15f-42e6-4f2f-a795-7c413d874681 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.742610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.766931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.767559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.768109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.768434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.781089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:41.786114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:41.787052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 340/672] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:41.792809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.821167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475300-13c7-47e0-a41e-66a57626013f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.848521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:41.857839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.858532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.858806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.859071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.865796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.867312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:41.879313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:41.880285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:41.881178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:41.887888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 333/673] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:41.887888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:41.907891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b183da6-9e27-44d5-b81d-ed835c5bfdf1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:41.949092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:41.949611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:41.949880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:41.950370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:41.950956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=57192d85635c489997ea172156dc4695) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:41.951267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:41.952784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:41.958949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 341/674] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/role_assignments?user.id=57192d85635c489997ea172156dc4695&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:41.959594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.000318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.016458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c41f54-40d9-4c4d-86ac-6a6af180ecde None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.068375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.069633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.070182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.070453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.080628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a9b42-1d87-4269-8740-9bbad8d98c51 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.081764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.084646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:42.101307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:42.102299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:42.103199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 334/675] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:42.103704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.126027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.126643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.127122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.127397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.128191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:42.128497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.129888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.140114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 342/676] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:42.141014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.160598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.228912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09158fa-7dd7-4769-9ed7-fd614df95ceb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.255107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.265584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f2f0-b4d8-4faf-92d6-36694331197b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.281301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.281917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.282189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.282454 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.290313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:42.290313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.290313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.298670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 335/677] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:42.299689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.311033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.312266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.312761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.313578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.314792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:42.315595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.317427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.333897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 343/678] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:42.335679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.413028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30f5e6-1811-4da9-900e-67f75d8fda03 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.422248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.446636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd456d1a-e206-4ff5-a4cc-4a79e3c0f71a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.448905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.449547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.449824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.450123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.461739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.463248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:42.478455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:42.479462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:42.480407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:42.480407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:42.480407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:42.480407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 336/679] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:42.480407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.487225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.487838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.488135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.488409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.489133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=50d240642e9246dbad42f8e379a60b21) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:42.489439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.490874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f55d63-9b50-4876-bd5e-3496520e4d4e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.508130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 344/680] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/role_assignments?user.id=50d240642e9246dbad42f8e379a60b21&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:42.508130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80450ab-f514-4a75-8c72-883fca432fa6 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.508130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80450ab-f514-4a75-8c72-883fca432fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.508130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80450ab-f514-4a75-8c72-883fca432fa6 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.508130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 345/681] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:42.508130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80450ab-f514-4a75-8c72-883fca432fa6 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.537643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.619945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a19687-9fd1-42b6-9c8c-0be3797a1b78 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.658856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80450ab-f514-4a75-8c72-883fca432fa6 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:42.668391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.669631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.669957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.670226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.670963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=6b143093bf1e4625a24a2e26ce5ba8a8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:42.671268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.672747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e281c-0944-4437-95a4-560ff70f7cab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.688395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 337/682] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/role_assignments?user.id=6b143093bf1e4625a24a2e26ce5ba8a8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:42.689895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.690187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.690459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.704687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:42.705309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:42.706349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:42.706632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:42.707351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:42.707597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:42.709345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:42.712451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:42.713792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:42.726297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 346/683] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:42.734973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:42.741146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.813079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 338/684] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:42.967690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:42.982265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1092c-cb57-4845-991c-925ee9e082c0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.018385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.019004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.019220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.019448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.026718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:43.028248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:43.040367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:43.041306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:43.042244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 347/685] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:43.047239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.100625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.185694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec9ff-032f-4bb4-aaec-9ef87f7bf9cc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.265881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c78bb-9b5a-49fb-b93b-11e03f93691d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.269836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.270453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.270726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.270992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.271725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:43.272024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:43.273473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:43.308225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.309263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.310429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.310897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.315035 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 339/686] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:43.320024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.321038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.323777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:43.330288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:43.348306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 348/687] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:43.349150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.349917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.503829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33217a31-9b8b-4842-9a10-a53625665a87 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.510295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fd0a9-927b-4291-9a6a-277267c5aaaa None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.540665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.541196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.541475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.541789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.604895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.605936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.606988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.607589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.608553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:43.609080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:43.610664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:43.611523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:43.616108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:43.625322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.630517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 349/688] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:43.636168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.721192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 340/689] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:43.727440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.801322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.839745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7235-f31d-4362-a921-4299e57584ce None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.852031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:43.876451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.877345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.877719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.878084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:43.880461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8ba93-1362-46ff-9098-1cc7cb130d71 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:43.891027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:43.892565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:43.909699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:43.910709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:43.912208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:43.912208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:43.912208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:43.912208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 341/690] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:43.916532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:43.980854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:43.981905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:43.982407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:43.982878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.006175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.007961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.025075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30200103-1500-4db1-adc8-a7863d886970 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:44.038295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:44.039570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:44.040552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:44.040552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:44.040552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:44.047059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 350/691] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:44.052574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.060471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.061080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.061357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.061624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.062257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:44.062553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.064108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.077195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 342/692] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:44.082884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.138528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.181123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b708b1f-4e4b-4cf1-871b-a481c7983042 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.195351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.207918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855076d-fc93-4c87-a3e5-b05bb2db67a6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.238082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.238692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.238964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.239229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.239864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:44.240185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.241845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.244111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.245029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.245434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.245810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.268360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.269509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 351/693] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:44.270182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.272923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:44.295852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:44.296815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:44.298842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 343/694] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:44.310461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.472853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181129e7-89d9-48c8-abb0-4fd5e87d6b11 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.483360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.508456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a0c5f-fa39-4acf-aa8a-faaa58232c27 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.520376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.521258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.521710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.522153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.529772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.531422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-c4dc1f2e-df13-4804-b359-dba4de678582 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:44.543263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:44.544773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:44.545726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:44.546268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 352/695] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:44.551032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31451e-17a5-4366-8083-e7b93e3bd8e2 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.551032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31451e-17a5-4366-8083-e7b93e3bd8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.551032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31451e-17a5-4366-8083-e7b93e3bd8e2 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.551032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 353/696] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:44.554743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.558416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31451e-17a5-4366-8083-e7b93e3bd8e2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.558516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.558516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.558516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.558516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:44.558516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.560006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664a249-e0d4-4a06-a43e-707ab68fe3cb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.577363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 344/697] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:44.577363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.577363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.577363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.592974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:44.594134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:44.603902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.672220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 345/698] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:44.678750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.688847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31451e-17a5-4366-8083-e7b93e3bd8e2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.729545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.731865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.732427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.733157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.734788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:44.735515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.738799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.775889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 354/699] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:44.778818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:44.839055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.893205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1641dca-20b6-4466-b7d2-8f011c504309 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.961484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:44.965410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:44.966771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:44.972458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:44.972730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:44.973489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=0b772e6cbf5f4fecbc91fc058ff29dc8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:44.973794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:44.974613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601891f3-0405-4d35-bb8f-5fea6680a97c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:44.975216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:44.996128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 346/700] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/role_assignments?user.id=0b772e6cbf5f4fecbc91fc058ff29dc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:45.005671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.030902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.031886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.032461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.032952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.119376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f68ac9-a890-415e-8d3f-b3dd419a6092 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.161768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.162467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.162737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.163003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] PATH_INFO: `/v3/services/network` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.163585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.165019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:45.169833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.172517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.173999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:45.178251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:45.179326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:45.180708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 347/701] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:45.185657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.314127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72927610-a4e0-46da-a582-e39afc0c8306 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.354359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.355042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.355290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.356008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.357068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] RBAC: Adding query filter params (name=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:45.357375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.359007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b35d7c-8530-4c8a-9b9f-5e73b82a9654 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:45.359988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.364665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 348/702] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:45.367242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fbf9-28a4-4d08-ac2f-3b7f72d15ded None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.367242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fbf9-28a4-4d08-ac2f-3b7f72d15ded None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.367532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937fbf9-28a4-4d08-ac2f-3b7f72d15ded None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.368848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 349/703] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:45.375801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041820f6-bb3c-4060-ad4f-685107e3131c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.376149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041820f6-bb3c-4060-ad4f-685107e3131c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.376468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041820f6-bb3c-4060-ad4f-685107e3131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.382826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 355/704] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 07 12:59:45.382826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.397158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-041820f6-bb3c-4060-ad4f-685107e3131c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:45.398356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-041820f6-bb3c-4060-ad4f-685107e3131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:45.466199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.475540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 350/705] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:45.479653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ff5e-1989-4e4a-af69-b8c3551b417f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.479653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ff5e-1989-4e4a-af69-b8c3551b417f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.479653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4ff5e-1989-4e4a-af69-b8c3551b417f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.479653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 351/706] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:45.479653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ff5e-1989-4e4a-af69-b8c3551b417f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.492961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeeb95-106c-4e8f-896d-a5cc0107b724 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.532222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.533166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.533621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.534202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.535037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] RBAC: Adding query filter params (type=network) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:45.535516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.537127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d02950-994e-4aeb-a668-3d58822a0a8f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:45.543250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 356/707] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:45.544710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.545224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.545695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.573756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:45.575914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:45.677600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4ff5e-1989-4e4a-af69-b8c3551b417f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.694353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.715136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 357/708] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:45.746201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.747370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.747645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.747913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.761111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.763110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:45.778151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:45.779990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:45.781085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:45.781085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:45.781085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:45.781085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 352/709] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:45.785250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.816359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:45.876791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:45.936300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de33ae-bab8-41fc-b588-761f88640f15 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.944248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38136f-e01c-41ef-accc-34a89bd1fa53 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:45.977831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:45.978469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:45.978792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:45.979058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:45.991131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:45.992640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:46.008663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:46.009687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:46.010570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:46.010570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:46.010570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:46.010570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 353/710] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:46.016966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.033601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.034216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.034488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.034754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.035393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:46.035687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.037086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.051759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 358/711] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:46.052653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.103105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.154341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.159730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e25d5a-bb50-4bc6-b416-de8529a97d87 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.168012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b7a42-3cb4-41ef-b3b8-2f58c5dbab76 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.209420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.209948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.210223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.210488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.211129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:46.211425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.212864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.213565 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.214763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.215253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.216314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.217183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.218784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.231478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 354/712] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:46.231478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:46.235575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:46.236627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:46.237561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:46.239629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 359/713] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:46.241374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.346492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3835e-c8df-49ed-8e1c-c84ad68f7eeb None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.346814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b2ef3-2ba1-4000-812d-4bfa4c22f431 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.362083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.389119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.389774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.390240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.390351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.390925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.392374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.395979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.396878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.397355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.397843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.407573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.409257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:46.421285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:46.422198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:46.423070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 355/714] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:46.423556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.447777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.481958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 360/715] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 12:59:46 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:46.481958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.550386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c59204-b66f-4151-b1fd-8215cd83b022 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.605301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.606908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.607421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.607893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.608815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:46.610916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.614812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.626422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 356/716] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:46.632130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.726584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e06f-445c-4fd7-9e9c-3107d4c0c2cf None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.745243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.765910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77567d-1e29-45bf-acf6-c377ed1e244b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.773053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.773998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.774899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.775365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.776279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:46.777191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.779966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.798532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 361/717] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:46.804351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:46.809668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.810286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.810560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.810829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.811461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:46.811761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.813151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aee0a-38da-4824-ada6-833a5c645432 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.820429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 357/718] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:46.838741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:46.932042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eea253-5024-42e4-93ae-b1417d967e16 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:46.976012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:46.977054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:46.977529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:46.978003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:46.978954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=08d7cfc07ef940b99652044bc7879601) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:46.979474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:46.981284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca6d01-9eb0-444a-bce8-ffe771a2bf5d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:46.988610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 362/719] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:46 2022] GET /identity/v3/role_assignments?user.id=08d7cfc07ef940b99652044bc7879601&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:47.673713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae8a48-cadf-461f-812a-d42497c9f17f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.674645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae8a48-cadf-461f-812a-d42497c9f17f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.675243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae8a48-cadf-461f-812a-d42497c9f17f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.677061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 358/720] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:47.689761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbbcbd-903c-440b-9532-fc304cafd914 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:47.690693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbbcbd-903c-440b-9532-fc304cafd914 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:47.691161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbbcbd-903c-440b-9532-fc304cafd914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:47.711227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f8cbbcbd-903c-440b-9532-fc304cafd914 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:47.717573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f8cbbcbd-903c-440b-9532-fc304cafd914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:47.811171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 363/721] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:48.122706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186efe9-c2db-41aa-b667-66c248143fb0 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.123057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186efe9-c2db-41aa-b667-66c248143fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.123251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186efe9-c2db-41aa-b667-66c248143fb0 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.124892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 359/722] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:48.132170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.132972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.133445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.162771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:48.166262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:48.182422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:48.211672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186efe9-c2db-41aa-b667-66c248143fb0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:48.258639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 364/723] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:48.378777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186efe9-c2db-41aa-b667-66c248143fb0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:48.429770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:48.430408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.430685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.430953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.448931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:48.455200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:48.456177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:48.457059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 360/724] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:48.462972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:48.668836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b81803-55a7-42a0-8e6e-1eaec5bce175 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:48.673104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:48.691008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:48.706356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:48.707548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.709416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.709416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.709416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:48.709416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:48.710454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:48.730588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 365/725] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:48.734946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:48.757346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:48.875331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2abe9-03e5-45cd-a109-747f9230d37d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:48.920591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a1e7cc-15d3-4e20-9237-3a7b7dcbfc64 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:48.945848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:48.946477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.946754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.947023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.947688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:48.953534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:48.981056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:48.982394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:48.982845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:48.983118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:48.994880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:48.996411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:49.020440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:49.021472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:49.023478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:49.023478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:49.023478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:49.023478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 366/726] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:49.027920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:49.068799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 361/727] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 12:59:48 2022] POST /identity/v3/services => generated 240 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:49.109387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:49.152886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18d331-c54b-4624-b4c8-ccb4174d5216 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:49.198226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:49.198811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.199093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.199363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.200052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:49.200385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:49.201852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:49.215855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 367/728] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:49.221718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:49.308725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:49.354440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f88be-9a97-4a3d-b959-2f1a965d272b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:49.395982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:49.396670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.396948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.397221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.406126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:49.407578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ce7ba66c-d8a7-4583-86ba-2767fadb7328 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:49.420720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:49.422999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:49.425292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 362/729] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:49.428380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:49.515327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5033-aae5-4360-9208-1b83264edcd3 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.515557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5033-aae5-4360-9208-1b83264edcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.515744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5033-aae5-4360-9208-1b83264edcd3 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.518090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 363/730] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:49.524873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8ed5-0501-4b79-8d03-793058d313d0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.524873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8ed5-0501-4b79-8d03-793058d313d0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.524873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc8ed5-0501-4b79-8d03-793058d313d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.548158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e0cc8ed5-0501-4b79-8d03-793058d313d0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:49.553365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e0cc8ed5-0501-4b79-8d03-793058d313d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:49.630068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c06a393-b923-4d61-a595-d3364056417c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:49.658323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:49.675548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:49.676441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.676878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.678385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.678385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:49.678385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:49.679589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcff2f-3de7-4b38-8bfa-a84f0b4bca5d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:49.681949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 364/731] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:49 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:49.683135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b12ac-1148-4c09-9a5f-6e199b34cecc None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.683418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b12ac-1148-4c09-9a5f-6e199b34cecc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.683685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b12ac-1148-4c09-9a5f-6e199b34cecc None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.685143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 365/732] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:49.686052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8929-b28e-479f-8b31-7fb6a12c44b7 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.686389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8929-b28e-479f-8b31-7fb6a12c44b7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.686660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62e8929-b28e-479f-8b31-7fb6a12c44b7 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.691860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 366/733] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:49.692476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.692476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.692725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.708534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 368/734] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 7 12:59:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:49.709907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.710185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.710452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.719578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:49.721103 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:49.732279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:49.733836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:49.787968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:49.821638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 367/735] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:49 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 07 12:59:49.822738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 369/736] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:49 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 07 12:59:49.823094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:49.928872 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b212e-84ed-43d8-9320-7216a05b9a30 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:49.964220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:49.965191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:49.966236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:49.966708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:49.979131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.053517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.085646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.087164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.095845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153d588-1e10-4347-955e-750a4bdc2545 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.112475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.134641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.135600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.136040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.136498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.149097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:50.154499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:50.155434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:50.156314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:50.158956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 370/737] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:50.168222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.268629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 368/738] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:49 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 07 12:59:50.268629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.293473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4274a9d-b98f-4ec0-8138-e4b7776d7f2e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.332131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.332683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.333074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.333339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.334124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:50.334427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.335796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.348876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 371/739] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:50.348876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.357619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.374156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb79c-2892-40d1-9673-b539fb6bd2e7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.379587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.411043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.411646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.412063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.412364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.413036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.414462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.453172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5aa122-8697-4d5a-8e50-fd0dbf16eb58 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.484467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 369/740] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 12:59:50 2022] POST /identity/v3/services => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:50.485471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.510249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.510893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.511171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.511442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.528776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:50.535666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:50.537426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:50.538254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:50.540253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 372/741] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:50.541236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.629727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbddee-62d1-4072-a9e7-3c301aa6a9c9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.668485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.678917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40265302-2c7c-4443-b129-bf78917154e1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.679989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.685463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.685463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.685463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.695229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.696746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.704871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:50.714493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:50.715457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:50.716446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:50.716446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:50.716446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:50.716446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 370/742] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:50.717735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.729350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.729995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.730297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.730539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.742832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.744434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:50.763122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:50.764167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:50.765085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:50.765085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:50.765085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:50.768330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 373/743] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:50.769177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.856762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fb8fb-842c-462d-a632-59a3e2545bbb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.902164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843db8e-7902-40f1-9867-9645a0ec5050 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:50.911408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.912027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.912347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.912618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.913285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:50.913584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.914948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.928384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 371/744] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:50.928384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.947078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:50.948114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:50.948670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:50.949144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:50.950582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:50.951088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:50.952798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:50.960726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:50.972217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 374/745] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:50.973467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:50.991695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.035363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf56bba-2ede-401e-9ef4-88d92d49eb07 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.070825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.071441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.071714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.071981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.072820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:51.073113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.074583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.087112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e07fa-16a4-474b-bfaf-471585c95ec9 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.092219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 372/746] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:51.093157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.126866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.127878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.128498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.128990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.140416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.142325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:51.159656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:51.160627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:51.161534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:51.161534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:51.161534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:51.167999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 375/747] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:51.169844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.198754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff198c-0755-47ea-8d53-924d351981aa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.220473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.227204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.235838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.236624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.236835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.237089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.244275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.245721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:51.257444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:51.258380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:51.259305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:51.263974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 373/748] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:51.264907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.287381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd776773-f811-4686-94e9-919bf0c614fd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.323837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.325394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.325879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.326376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.334919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.336731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:51.350697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:51.351741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:59:51.352739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:51.361676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 376/749] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:51.363135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.375289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57ee50-47b6-43b9-9b4d-085bce31e842 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.437476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.438028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.438301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.438571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.439232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:51.439536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.440987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.468158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 374/750] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:51.468158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.544472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.570362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d172c-c27b-432a-b124-df435449e01d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.598393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.617993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a983b-fb4a-40d0-a1d0-95aa5b9da305 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.647153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.651015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.651420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.652069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.653365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:51.654057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.655836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.669734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.670020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.670267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.670567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.671269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:51.671572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.677548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 377/751] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:51.677705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ff2ae2-eb11-4eee-b694-7c69fe947928 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.677784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.695388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 375/752] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:51.697298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929428b-6856-4bc9-8d6a-dd873dedcf8d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.698498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929428b-6856-4bc9-8d6a-dd873dedcf8d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.698775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929428b-6856-4bc9-8d6a-dd873dedcf8d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.704922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 376/753] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:51.705800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929428b-6856-4bc9-8d6a-dd873dedcf8d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.800874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e76e-c1f4-4111-8466-8354905163c1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.834882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.841444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929428b-6856-4bc9-8d6a-dd873dedcf8d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:51.849512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.863362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.863362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.863362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.863362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.863362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:51.878116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:51.879243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:51.880372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:51.886182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 378/754] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:51.886182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:51.886411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:51.886411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.886411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.886411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.886677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=0b772e6cbf5f4fecbc91fc058ff29dc8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:51.886677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:51.887068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb6bcff-6c2f-4df3-8933-de67172c2660 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:51.912421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 377/755] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/role_assignments?user.id=0b772e6cbf5f4fecbc91fc058ff29dc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:51.913763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:51.914044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:51.914312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:51.923179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:51.934715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:51.935995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:52.008518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c97f4-bb44-4c03-98e5-4853fd8b583e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.015786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 378/756] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:59:52.016725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.050258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.051292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.051752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.052260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.140417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.148943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.150487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.150815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761120fe-12fe-447c-8037-45c7a4959352 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.189449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.190602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.191065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.191543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.192909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:52.193503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.195392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.216347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.218306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 379/757] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:52.224755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.336478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7431-70be-428a-ba41-81d6a8318d26 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.364264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 379/758] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:52.365120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.375471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.376498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.376981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.377539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.388855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.390839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:52.407594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:52.408712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:52.409818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:52.409818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:52.409818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:52.411665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 380/759] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:52.417294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.432629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.474791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9240b5-47ba-4123-a12a-f1616361b259 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.504789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.511110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.511754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.512035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.512364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] PATH_INFO: `/v3/services/network` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.513100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.514571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:52.523990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:52.525021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:52.525950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 380/760] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:52.526757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.533540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b90c52-ed95-45b1-afc9-3bb4832375fa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.575113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.576261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.576883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.577378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.589607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.591935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:52.609971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:52.610963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:52.611849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:52.611849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:52.611849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:52.614113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 381/761] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:52.615175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.633246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de128d48-ce61-4acd-80a9-507a841b1f06 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.675911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.676554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.676830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.677097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.677900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:52.678138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.679517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.684636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.697648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 381/762] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:52.697648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.746192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ecf3-87d5-4a03-9cd8-fef99655cbd0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.764733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.787235 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.788705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.789183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.790070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.790903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] RBAC: Adding query filter params (name=network) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:52.791402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.792990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.799718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 382/763] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:52.800883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.817303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718eab6c-b986-4fc0-8c8b-ec8dffcfe670 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.857267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.857814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.858095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.858354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.859017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:52.859320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.860772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.874153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 382/764] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:52.875012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:52.917309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85277f-0a56-4053-8eeb-ce579c75063e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.939503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:52.960493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:52.961386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.961775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.962131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.969670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:52.971268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-38b0410c-8ab4-4bea-b4ec-45498d12bcdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:52.983420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:52.984523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:52.985593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:52.991629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 383/765] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:52.991760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcf830-7b38-45a1-a89d-e8e69e81f2ab None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:52.992851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16378f-0de1-41c6-8262-2b1628beb465 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:52.993194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16378f-0de1-41c6-8262-2b1628beb465 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:52.993567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16378f-0de1-41c6-8262-2b1628beb465 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:52.995090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 384/766] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:52.995652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16378f-0de1-41c6-8262-2b1628beb465 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.013678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.037093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.038713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.039188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.039638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.040593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] RBAC: Adding query filter params (type=network) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:53.041100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.043122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.049492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 383/767] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:53.050826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.108984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16378f-0de1-41c6-8262-2b1628beb465 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.144883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.145507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.145780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.146052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.152905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.154479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.159001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481a66-0e30-484c-a454-35a9df41f9da None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d6918bdf-4c84-4d10-bfa9-595e7aee39f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:53.166922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:53.167841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 385/768] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.173963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.174578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.192034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:53.193265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:53.195608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.197038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.197314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.197633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.198319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:53.198616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.200779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.220245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 384/769] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:53.221123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.229212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.265214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.280107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 386/770] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:59:53.280107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.358441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112901f-3e8a-4b84-888d-ec2daac82fbb None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.383589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82416970-3c64-4150-a213-b4a38aa8fdb9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.403525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.404234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.404614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.404984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.405778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] RBAC: Adding query filter params (interface=public, service_id=ba1e066fbb8f4848a781b13a345633ed, region_id=RegionOne) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:53.406186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.408401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.421249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.422146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.422583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.422743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 385/771] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/endpoints?service_id=ba1e066fbb8f4848a781b13a345633ed&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:53.423126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.423747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.424531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:53.425020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.426685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.441019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 387/772] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:53.442065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.473380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.537774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1536e-0a9d-4f11-889f-72296583be32 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.539312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.550516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78762e1d-09a0-47e0-af59-a725a2618f58 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.578941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.579857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.580809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.581507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/08d7cfc07ef940b99652044bc7879601/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.583806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=08d7cfc07ef940b99652044bc7879601, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.585411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.586006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.586615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.586894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.587169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.587775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.589191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.595058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 388/773] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:53.595836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.668717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 386/774] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:53 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/08d7cfc07ef940b99652044bc7879601/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:53.670630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:53.718674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:53.729293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58390-49b4-47ea-bf7b-12df747c051e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.811189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7f63b-20a2-4965-bd29-0a508d9a30ab None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:53.830886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.831554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.831837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.832122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.832871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=3516227f02da4f1b90b74577c1fe1cf6) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:53.833181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.834836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.842046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 389/775] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/role_assignments?user.id=3516227f02da4f1b90b74577c1fe1cf6&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:53.856502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:53.857846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:53.858313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:53.858799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:53.859629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:53.861344 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:53.872408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:53.873549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:53.874426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:53.877467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 387/776] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:53.884030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.019441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55eac8-88c6-40b0-b99d-40a24a50eb51 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:54.061915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:54.062544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.062822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.063092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.063729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:54.064029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:54.065439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f66474-612c-487f-96d9-4669fdb59a5d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:54.072551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 390/777] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 7 12:59:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:54.078228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.119270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.194488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51551a0-2b72-45a2-8b66-7b2445f7d173 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:54.219018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a386-c61b-4f40-a22f-198dfab97a95 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.219332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a386-c61b-4f40-a22f-198dfab97a95 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.219557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a386-c61b-4f40-a22f-198dfab97a95 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.221122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 391/778] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:54.228393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.228669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.228939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.241034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:54.241927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.242459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.243027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.243843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:54.244368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:54.245919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:54.251641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 388/779] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:54.257215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.270940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:54.272472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:54.290822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.355375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 392/780] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 07 12:59:54.405296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:54.415500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455ab62-4e92-4510-b5b3-5c9439ac9bd7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:54.454506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:54.455401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.455849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.456346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.457220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] RBAC: Adding query filter params (interface=public, service_id=89e16f79fad74273becd477a2ed41919, region_id=RegionOne) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:54.457706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:54.459298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:54.465110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 389/781] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/endpoints?service_id=89e16f79fad74273becd477a2ed41919&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:54.472845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.596192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08115967-952c-407a-b58c-ba6721c3fbec None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:54.639133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:54.640038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.640544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.640983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.641780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:54.643556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:54.650614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 393/782] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:54.655900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.804555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44df42-53f2-4ece-972b-ccb3fe2cb975 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:54.861884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:54.862491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:54.862731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:54.862986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:54.878922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:54.883716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:54.884671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:54.886159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 390/783] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:54.891639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:54.933639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:55.056997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81cc0-79b1-4077-bdb5-fca9b290a191 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:55.097621 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:55.098606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:55.099077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:55.099566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:55.100456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:55.100951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:55.102509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:55.113795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 394/784] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:55.119322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:55.153676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:55.276601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fff17f-02e8-42b2-beea-959fa16241b3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:55.330084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:55.330712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:55.330985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:55.331260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:55.343678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:55.345155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:55.363996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:55.365014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:55.366611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:55.366611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:55.366611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:55.366611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 391/785] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:55.372241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:55.503325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:55.528903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa4b81-6cc4-4d28-9770-74681222bd40 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:55.568485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:55.571047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:55.571047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:55.571047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:55.571047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:55.571047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:55.572829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:55.586381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 395/786] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:55.592244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:55.696827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:55.741823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b87a0-36e7-4f10-b1ad-1790c6d59b74 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:55.792999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:55.794161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:55.794438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:55.794709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:55.806290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:55.807729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:55.818928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:55.819875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:55.821492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 392/787] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:55.826313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:56.026375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1faeae4-0cd9-4999-b261-05762aff13cd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:56.082097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:56.082731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.083001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.083265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.084010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:56.084335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:56.085768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d5085-fd99-41ff-92d4-2758d0c95684 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:56.093281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:56.111765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 396/788] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 7 12:59:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:56.117436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:56.188225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736cec8-e5e9-4456-92a4-ec18d6dcb305 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.188916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736cec8-e5e9-4456-92a4-ec18d6dcb305 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.189382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736cec8-e5e9-4456-92a4-ec18d6dcb305 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.191198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 397/789] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:56.196618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.197126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.197591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.218516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:56.220161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:56.338721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36e59b-b055-4128-8692-31a92617c281 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:56.361670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 398/790] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:59:56.381446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:56.391374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:56.400129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.400129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.400129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.405527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:56.407193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b386e2e6-b71d-46ae-bb6c-1bb2c26aac1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:56.422673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:56.423614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:56.424539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:56.424539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:56.424539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:56.426646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 393/791] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:56.433161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:56.497654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134dde4-a50c-48f5-9435-27c8af8773e8 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.498270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134dde4-a50c-48f5-9435-27c8af8773e8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.498735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134dde4-a50c-48f5-9435-27c8af8773e8 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.500774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 394/792] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 12:59:56.514488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.515077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.515810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.556375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:56.562515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:56.595328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ba3b5-362f-44ea-9c40-6bc1cff07f83 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:56.624663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:56.656510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:56.657145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.657422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.657689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.658351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:56.658652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:56.660050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:56.693319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 399/793] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:56.705082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:56.709412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 395/794] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:59:56.735538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:56.861533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc6cf5-4f5b-4f0f-8e4c-3053f66af9ed None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:56.861712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5944807-d66c-454f-b21a-d5a298f5c1e8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:56.871474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:56.909060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:56.910645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:56.911270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.912030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.912500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.912940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.913345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] PATH_INFO: `/v3/services/network` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.913749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.914475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:56.916521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:56.923991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:56.925578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-891fd3e1-3c1b-4774-9a17-b12024d0ea6b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:56.926025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:56.927175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 07 12:59:56.928010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:56.930646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 396/795] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:56 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:56.932065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e178-7529-4d06-b6f9-384cbb5f22a3 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.932557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e178-7529-4d06-b6f9-384cbb5f22a3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.933016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0e178-7529-4d06-b6f9-384cbb5f22a3 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.935190 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 397/796] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:56.936667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e178-7529-4d06-b6f9-384cbb5f22a3 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c0249f9c-fe66-417e-8502-8ca7fc53ea87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:56.945657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:56.946547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:56.947442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:56.952022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 400/797] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:56.953382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:56.953669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:56.953942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:56.979064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:56.980294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:57.032608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.052563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0e178-7529-4d06-b6f9-384cbb5f22a3 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.058461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 401/798] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 12:59:57.062352 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.093254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.093856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.094143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.094442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.095001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] RBAC: Adding query filter params (name=network) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:57.095299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.096804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.102061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 398/799] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 12:59:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:57.102950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.144643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.204963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c2c17-5549-43f3-9cf8-8d650de6f9ef None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.216207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b98c8-8daa-4607-9ef0-a7b42e4ddd6c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.252466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.253093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.253362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.253627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.255817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.256951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.257474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.257944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.259263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:57.259834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.261935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.264606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:57.269761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:57.270736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 399/800] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:57.276728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.284399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 402/801] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:57.285565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.321663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.384734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.391776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dbade-806f-4576-bfbf-b63140562f4c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.398212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd980b8-8b80-4216-bd6d-74071bd07e5f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.436516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.437155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.437392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.437660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.438280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:57.438581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.439952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.440906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.441514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.441786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.442055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.442708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:57.443007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.444360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.450066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 400/802] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:57.450066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.462592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 403/803] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:57.463484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.555492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff2264-ec4e-4756-a5af-4679d79ac3b3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.561331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.566986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584fb98-c35e-4018-80d3-50a9dfec657e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.589696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.590369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.591146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.591410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/0b772e6cbf5f4fecbc91fc058ff29dc8/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.593279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=0b772e6cbf5f4fecbc91fc058ff29dc8, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.594701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.601781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.602407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.602683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.602952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.613664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 12:59:57.618425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:57.619476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 404/804] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:57.620564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.695808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 401/805] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 12:59:57 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/0b772e6cbf5f4fecbc91fc058ff29dc8/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 12:59:57.696696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.721915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.730758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d026-9e6b-4257-ab5d-2739930f9eaa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.770573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acfa98-accf-4501-8e32-ec33706ce477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.771200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfa98-accf-4501-8e32-ec33706ce477 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.771478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfa98-accf-4501-8e32-ec33706ce477 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.771743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acfa98-accf-4501-8e32-ec33706ce477 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.772462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acfa98-accf-4501-8e32-ec33706ce477 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.773866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acfa98-accf-4501-8e32-ec33706ce477 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.810884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbea5b-ae40-4b04-b0c8-242669429113 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:57.850799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:57.851508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.851788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.852058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.863920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:57.865549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:57.883187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 405/806] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 12:59:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-65cde014-678f-4de2-845f-4fffef740c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:57.883667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:57.884921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:57.885847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:57.885847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:57.885847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:57.886030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b565-c631-49e2-8371-3593e6328fbd None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.886030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b565-c631-49e2-8371-3593e6328fbd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.886030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955b565-c631-49e2-8371-3593e6328fbd None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.886429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 406/807] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 12:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 12:59:57.891557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 402/808] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:57.891781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b565-c631-49e2-8371-3593e6328fbd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:57.893663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:57.893943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:57.894225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:57.909165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:57.915564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 12:59:57.916764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 12:59:58.005202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.012824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 403/809] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 12:59:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 12:59:58.014021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.038377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955b565-c631-49e2-8371-3593e6328fbd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.091995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.092672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.092949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.093485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.095091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:58.095410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.096852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.109099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 407/810] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 12:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:58.117122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.142690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2708e48-5810-44fc-9045-4b862df3ec1a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.182672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.183963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.184605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.185090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.185951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:58.186444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.188050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.201390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 404/811] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:58.211201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.244474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.277639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c1b1-46ab-47d6-8fcf-d3ede877882a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.284468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.323947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.324641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.325435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.325758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.334675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ce45e-f413-4e8b-b0e6-0ff9dfe0b66a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.340787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.342296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:58.362972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:58.364034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:58.365039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:58.365039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:58.365039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:58.365210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 408/812] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:58.370277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.373512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.374214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.374490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.374757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.382613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.384050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:58.396053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:58.397026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 405/813] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 12:59:58.398004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.491433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb120c0e-d7f7-4bc7-b8e6-3b6e141fb739 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.508820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dbe0-4e0f-4f7c-adba-212bcd7c9b16 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.520223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.528409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.529307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.529996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.530276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 12:59:58.547395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 12:59:58.548036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:58.549046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 409/814] 10.222.0.57 () {56 vars in 1129 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:58.549934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.553327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.553948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.554602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.554885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.555544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:58.555850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.557368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.570363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 406/815] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:58.571218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.655256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3a0d-2c52-482a-aea4-85f71878ce7b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.686484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e845-809f-4119-bbae-6b3d88021389 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.697402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.698017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.698293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.698562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.699293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:58.699601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.701760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.719954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 410/816] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:58.725248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.727924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.729301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.729301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.729301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.729935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:58.730293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.732299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.736969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 407/817] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:58.742264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.777655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.787953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:58.832127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cfb25-c600-47fd-856d-40222ca75b91 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.845724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b97521-0624-4621-abf9-30bf5b70f8f1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:58.868740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.869375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.869648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.869914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.878165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.879594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:58.881772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:58.882483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:58.882863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:58.883234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 12:59:58.891429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:58.892604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 12:59:58.894029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:58.896412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 411/818] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:58.897187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:58.961727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:58.963186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.004271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41925dd4-23d7-4a97-91a6-7cce817ed9da None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.006313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.015399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.042350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.043593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.043832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.044191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.045212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:59.045580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.047329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.057012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 412/819] 10.222.0.57 () {56 vars in 1124 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:59.057012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.076127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 408/820] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 12:59:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 12:59:59.076827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.171939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75c5f-4ec7-490f-be01-6b93de254811 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.184968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b3f9d-cf74-40b4-9633-b2f9809daa68 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.209199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.209811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.210084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.210355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.211081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:59.211381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.212824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.221123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.221713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.221984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.222245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.222915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.224288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.235336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 413/821] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 12:59:59.235336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.261117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.303814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.310966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 409/822] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 12:59:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 12:59:59.311870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.354142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefedac-704b-403f-a35b-982f8706df0c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.424291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.424964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.425238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.425500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.435574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5f3f9-00f7-4e85-a070-3c52ffb3c61e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.440446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.442751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:59.459179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:59.460245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:59.461162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:59.461162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:59.461162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:59.461162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 414/823] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:59.466204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.482221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.483327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.483811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.484318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.497580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.499448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 12:59:59.515711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:59.516740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 12:59:59.517631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 12:59:59.517631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 12:59:59.517631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:59.520107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 410/824] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:59.525547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.562893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.590976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca42c7-8524-4e60-8d41-30305ae4b585 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.634231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.635062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.635871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.636393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.636758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.638284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:59.638670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.640040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.656951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccf430-3e95-4b2d-93bc-3ffca6b236f5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.657147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 415/825] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:59.667618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.698241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.698909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.699239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.699561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.700750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 12:59:59.701053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.702430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.714708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 411/826] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 12:59:59.720945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.799467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469fe60-9db7-4897-9a7e-711f8da5afe4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.824551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585820-b22e-4677-9dc7-7f05eeba4a19 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 12:59:59.849100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.851615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.852694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.853522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.853954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.864802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.865065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 12:59:59.865710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 12:59:59.866027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 12:59:59.866304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 12:59:59.867336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.869920 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 12:59:59.874915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 12:59:59.876843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:59.883677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:59.888013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:59.889078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 12:59:59.891515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 416/827] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:59.892344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 12:59:59.893506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 12:59:59.895320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 12:59:59.897466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 12:59:59.903559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 412/828] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 12:59:59.903559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.012543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85396fd-09a8-48b2-8b57-3143b19c8be4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.012987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b186-1e77-4bc7-ae90-e3a266284302 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.048438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.049026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.049132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.049598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.049598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.049741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.049978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.050225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:00.050323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.050527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:00.050931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:00.051236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:00.051952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c42883-8a41-4713-b1e7-cdba392e659d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:00.052683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea6061-5339-4cf6-9608-bbf3f00ad534 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:00.065416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 413/829] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:00.066440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b1c80-d349-4c81-b37b-a13ca51e3b14 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.066704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b1c80-d349-4c81-b37b-a13ca51e3b14 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.066972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b1c80-d349-4c81-b37b-a13ca51e3b14 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.068346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 414/830] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:00.075455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 417/831] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 12:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:00.075633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b1c80-d349-4c81-b37b-a13ca51e3b14 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.075729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.075729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.075729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.093654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:00.094850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:00.108691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.151008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.166720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 418/832] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:00.167789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.182451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b1c80-d349-4c81-b37b-a13ca51e3b14 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.217966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.218885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.219233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.219579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/3516227f02da4f1b90b74577c1fe1cf6/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.235043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=3516227f02da4f1b90b74577c1fe1cf6, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:00.236693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:00.294834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfd5c7-818e-4d8e-8835-ad45159eb160 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.327728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 415/833] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:00:00 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/3516227f02da4f1b90b74577c1fe1cf6/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:00:00.342997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.343801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.344161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.344627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.345501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=08d7cfc07ef940b99652044bc7879601) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:00.345821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:00.347357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:00.355060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 419/834] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:00 2022] GET /identity/v3/role_assignments?user.id=08d7cfc07ef940b99652044bc7879601&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:00.451471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.547043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.569798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05766855-fec8-44c9-99a8-513156fb8d88 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.609098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.609517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.609796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.610113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.623681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:00.628671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:00.629610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:00.630443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 416/835] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:00:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:00.637863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.706007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.756756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dbf10-1122-4042-abb3-81388d4ceb66 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.794253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.795245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.795736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.796233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.797089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:00.797599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:00.799209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:00.812203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 420/836] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:00.814604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:00.921307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de9738-be96-4b0d-8b13-b4fecf18885c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:00.957748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:00.958793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:00.959265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:00.959729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:00.969267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:00.972368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:00.974208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:00.990051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:00.991039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:00.991922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:00.991922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:00.991922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:00.994005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 417/837] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:00.999879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:01.111626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f47da-45df-4536-979f-bf19d8baf93d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:01.128417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:01.151962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:01.153540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.157823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.157823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.157823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:01.157823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:01.157823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:01.170687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 421/838] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:01.176818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:01.289070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a1498-0e0e-4029-89d0-33f0976c36a5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:01.327388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:01.328479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.328975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.329437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.337588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:01.339301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:01.351101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:01.352019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 07 13:00:01.352986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:01.355378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 418/839] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:00:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:01.362565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:01.479835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e4175-1402-481b-82cd-e49b48f11c8d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:01.521739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:01.522873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.523347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.523811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.524775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:01.525361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:01.526981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b4440-2a20-497b-8e91-ae9a2681e6fd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:01.547253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 422/840] 10.222.0.57 () {56 vars in 1135 bytes} [Wed Sep 7 13:00:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:01.553225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:01.603663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba0c3-3ab1-4129-8327-0f2ae258df73 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.604299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba0c3-3ab1-4129-8327-0f2ae258df73 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.605194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acba0c3-3ab1-4129-8327-0f2ae258df73 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.607911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 423/841] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:01.613071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.613622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.614081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.615603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:01.636077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:01.637317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:01.667452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089be4d5-300b-4761-b76f-2d57095d4e77 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:01.678984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:01.703702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:01.704725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:01.704725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:01.704983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:01.719895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 424/842] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:01.794323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:01.796207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:01.848422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:01.901665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 419/843] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:00:01.907729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.010766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695dd52-cf2c-46b5-812e-6fe1e4e09027 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.021778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.050085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.051126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.051732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.052576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.069360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.071393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:02.094187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:02.095207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:02.096107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:02.096107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:02.096107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:02.098442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 425/844] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:02.104280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.123822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:02.130269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7eca7-928e-4329-b514-d1c826a0326b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.165990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.166686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.166889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.167157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.167738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.169694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:02.178782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:02.179772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:02.180647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:02.184222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 420/845] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:02.186036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.205348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:02.232175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32aa9c-0a94-4455-816f-6f345c7dd2d5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.272451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.273406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.273971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.274453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.275413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:02.275964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.277669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.291322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731e04b-3fc3-4040-8b0b-c635319b2b20 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.300859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 426/846] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:02.302041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.340304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.342742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.343219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.343706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.344613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:02.345113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.347208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.353983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 421/847] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:02.360227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.397074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:02.433828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b837-c8ba-4dfd-933a-394ae62624ea None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.459070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:02.475652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.476548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.477006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.477428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.484482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6e4a-1140-4820-8e47-70e8a41bb1ac None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.486389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.488165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:02.501737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:02.502706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:02.503661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:02.511319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 427/848] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:02.513240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.532962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.533767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.534059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.534312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.534943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:02.535242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.537184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b008c8db-5b97-4bca-a381-ecd0e9e4b3c4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.545383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 422/849] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:02.615057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be87a7-452d-4cb6-8423-5cd105284b98 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.615734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be87a7-452d-4cb6-8423-5cd105284b98 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.616414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be87a7-452d-4cb6-8423-5cd105284b98 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.618172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 423/850] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:02.626015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442abd-6528-44e5-a806-b2039c5a2265 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.626458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442abd-6528-44e5-a806-b2039c5a2265 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.626809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9442abd-6528-44e5-a806-b2039c5a2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.648816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e9442abd-6528-44e5-a806-b2039c5a2265 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:02.650186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e9442abd-6528-44e5-a806-b2039c5a2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:02.667207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19499-21cd-43f5-82eb-b06cbd8744b8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.706662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.707291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.707565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.707834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.708576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:02.708879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.710351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7bd24d-e96f-4d8b-9544-5e5fb6e9f6d0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.712404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:02.730242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 428/851] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:02.730242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abaca8-6245-48b9-ada2-2ffa73b6c606 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.730242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abaca8-6245-48b9-ada2-2ffa73b6c606 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.730242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abaca8-6245-48b9-ada2-2ffa73b6c606 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.730242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 429/852] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:02.733974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abaca8-6245-48b9-ada2-2ffa73b6c606 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:02.748361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 424/853] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:02.751921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.751921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.751921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.774901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:02.776271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:02.849787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 425/854] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:02.855112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abaca8-6245-48b9-ada2-2ffa73b6c606 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:02.891020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:02.892019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:02.892445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:02.892971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:02.894229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=0b772e6cbf5f4fecbc91fc058ff29dc8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:02.894675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:02.896291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:02.902759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 430/855] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:02 2022] GET /identity/v3/role_assignments?user.id=0b772e6cbf5f4fecbc91fc058ff29dc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:03.019249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.022923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.129275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.139512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3056d81-d886-4125-b0f7-67bcbaa2faf7 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.177574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.178546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.179019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.179482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.190525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:03.195549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:03.196495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:00:03.197345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:03.200013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 426/856] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:03.205484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.208453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.259032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259a4ea-c823-4c70-8ae6-2efb48227743 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.272563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.303704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.304852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.305310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.306060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.307096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.309243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.314593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5c112-25d2-42d0-9849-10b94538e6b4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:03.321267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:03.322212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:03.323108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:03.326366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 431/857] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:03.331647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.361577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.362337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.362616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.362887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.363603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:03.363907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.365386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.379553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 427/858] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:03.381589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.458170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f676824-00c2-48f8-b7cb-0335a5d0ffe1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.485957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.498165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d140692-0197-4b56-9c81-59574f4e125b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.503252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.504747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.505454 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.506349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.507166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:03.507999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.510056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.521665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 432/859] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:03.525135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.544684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.545379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.545654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.545921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.556390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.561771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.564035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:03.582803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:03.583802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:03.589902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:03.589902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:03.589902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:03.589902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 428/860] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:03.593505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.672010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e70489-d10c-493a-9cbe-453586453f1b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.714356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.714890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.715282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.716109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.716747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:03.717044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.718904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.728262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 433/861] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:03.737458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310f00c-8029-4715-9e55-7d67c7974fa7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.779302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.780369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.780853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.781325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.782295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:03.782803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.784588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.804119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 429/862] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:03.805989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:03.868458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:03.923318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69cf64-cd6e-4b94-8f07-2b9781fb2e55 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:03.959311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:03.959951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:03.960260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:03.960528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:03.969229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:03.970909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:03.985973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:03.986923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:03.987854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:03.990290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 434/863] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:03.995788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:04.038683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.106819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7564e2-86d9-4cb7-aacd-96f0f0335e48 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:04.144963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:04.145866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.146319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.146754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.147624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:04.148152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:04.149726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:04.172769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 430/864] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 7 13:00:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:04.175317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:04.281996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58a37e-8162-424c-a58c-d512484646c1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:04.293221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.317488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:04.318104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.318377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.318647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.395476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:04.397402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:04.508112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 435/865] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:04 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:00:04.509832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:04.609928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.616638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdbd6b-7a24-4cb7-a3d8-9628354be027 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:04.658993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:04.659972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.660969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.661463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.676425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:04.678139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:04.697502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:04.698523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:04.699946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:04.699946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:04.699946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:04.699946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 431/866] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:04.706870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:04.720531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:04.820518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d928f-6497-4505-bc67-f7beb7f7b1c9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:04.857128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:04.858107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.858588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.859071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.859921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:04.860503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:04.862063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e1d0-2cf4-44de-8cef-06b870f924f6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:04.878803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 436/867] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:04.880591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:04.894310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b817f6-1e19-40a5-a67c-a960707c93e9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.894890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b817f6-1e19-40a5-a67c-a960707c93e9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.895387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b817f6-1e19-40a5-a67c-a960707c93e9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.897492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 437/868] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:04.904311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:04.904616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:04.904882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:04.924115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:04.925317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:04.999096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:05.005340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac847-4484-4328-8c8b-7d1b6c1417e2 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:05.005610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 438/869] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:05.044382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:05.045442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.045925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.046439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.055157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:05.057219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-0ebd9966-ff03-4239-aa7d-430241a7e7d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:05.071062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:05.072032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:05.073253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:05.080217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 432/870] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:05.082692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:05.173162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9aa8b-075a-4294-bfee-b0ac025ece2a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.174061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9aa8b-075a-4294-bfee-b0ac025ece2a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.174546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9aa8b-075a-4294-bfee-b0ac025ece2a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.176781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 433/871] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:05.182281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.182562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.183084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.193585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0f00a-2c6a-46fb-bce8-773e8c041f1d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:05.201812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:05.203337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:05.205173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:05.238049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:05.239885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.240400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.240875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.241804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:05.242341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:05.243980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:05.267913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 439/872] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:05.269798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:05.284231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 434/873] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:05.287584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:05.348372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:05.404038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e990bed-064c-4dde-a8c1-aed9c14dec47 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:05.411267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9836f81-8cf9-429f-ab7c-90bcbcbfb1a9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:05.442327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:05.443255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.443685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.444124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.445037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=3516227f02da4f1b90b74577c1fe1cf6) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:05.445526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:05.447180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:05.454419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 440/874] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:05 2022] GET /identity/v3/role_assignments?user.id=3516227f02da4f1b90b74577c1fe1cf6&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:05.464127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:05.464127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.464127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.464127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.464556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:05.464556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:05.553683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:05.554882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:05.566023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 435/875] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:05 2022] POST /identity/v3/services => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:00:05.681221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da601ed6-6cb8-4049-b9a8-ccaea8873764 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:05.708176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:05.727229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:05.727891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.728187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.728454 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.729040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:05.730429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:05.742419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:05.743490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:05.744814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 441/876] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:05.751626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:05.873680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da619-0367-418e-aa64-b6208d8f7c53 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:05.910329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:05.910965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:05.911241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:05.911511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:05.912189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:05.912494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:05.913928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a091-7f76-4b49-835b-6fb64506c8d9 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:05.920720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 436/877] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:05.926600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:06.034619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fd147-ee38-45a9-866a-8630fe7474a8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:06.055089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ed02-c393-48fe-b202-30d754ead1f8 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:06.055702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ed02-c393-48fe-b202-30d754ead1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:06.056224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85ed02-c393-48fe-b202-30d754ead1f8 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:06.058254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 437/878] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:06.063772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d168-e11b-48b7-9cb6-bf265bbb91a1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:06.064358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d168-e11b-48b7-9cb6-bf265bbb91a1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:06.064848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9d168-e11b-48b7-9cb6-bf265bbb91a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:06.071301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:06.071909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:06.072229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:06.072561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:06.073094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:06.073390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:06.074978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:06.080124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 442/879] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:06.093236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-59d9d168-e11b-48b7-9cb6-bf265bbb91a1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:06.094845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-59d9d168-e11b-48b7-9cb6-bf265bbb91a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:06.160368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:06.174338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 438/880] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:06.444563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:06.497691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:06.553786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29601427-5101-42dc-bc29-2a48ca49fc66 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:06.592022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87281d-262d-41de-a66b-6ec2a0986cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:06.592669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87281d-262d-41de-a66b-6ec2a0986cfc None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:06.592952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87281d-262d-41de-a66b-6ec2a0986cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:06.593218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87281d-262d-41de-a66b-6ec2a0986cfc None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:06.593880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87281d-262d-41de-a66b-6ec2a0986cfc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:06.595243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87281d-262d-41de-a66b-6ec2a0986cfc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:06.682925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 443/881] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:06 2022] POST /identity/v3/services => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:07.813508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d853-5338-44a5-a397-eb9070784a00 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.814023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d853-5338-44a5-a397-eb9070784a00 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.814023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2d853-5338-44a5-a397-eb9070784a00 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.815629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 439/882] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:07.821179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.821600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.821786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.844013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:07.845615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:07.862066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da46b4-3df1-4a87-9c67-b25400db91b6 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.862419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da46b4-3df1-4a87-9c67-b25400db91b6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.862619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da46b4-3df1-4a87-9c67-b25400db91b6 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.864338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 440/883] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:07.869427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:07.869720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:07.870072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:07.891128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:07.892636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:07.936511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 444/884] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:07.970369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 441/885] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:08.206528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.240878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.241627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.334476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cdf64-ff5f-4bc3-9000-5c88e3d68226 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.353954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578cb0a-5370-4311-9593-7baf0fbbeb83 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.377508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f579f-746e-4e0b-a00b-cdb9d718667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.378237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f579f-746e-4e0b-a00b-cdb9d718667a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.378500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f579f-746e-4e0b-a00b-cdb9d718667a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.378681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f579f-746e-4e0b-a00b-cdb9d718667a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.379889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.391304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f579f-746e-4e0b-a00b-cdb9d718667a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:08.393791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.393791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.393791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.394251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.394828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.396220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-df6f579f-746e-4e0b-a00b-cdb9d718667a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:08.396399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:08.397331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:08.398244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 445/886] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:08.398996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf455-e37f-422e-9a93-7fb7ea0c63b8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.399584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf455-e37f-422e-9a93-7fb7ea0c63b8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.399584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbf455-e37f-422e-9a93-7fb7ea0c63b8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.401497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 446/887] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:08.405166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf455-e37f-422e-9a93-7fb7ea0c63b8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-578ec759-3432-4c1c-92a9-4351bca47ded None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:08.413638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:08.414775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:08.415633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 442/888] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:08.422227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.422227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.422227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.439561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:08.440778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:08.508412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.524115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 443/889] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:08.524115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.529092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbf455-e37f-422e-9a93-7fb7ea0c63b8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.566339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.567577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.567915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.568305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.569042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:08.569931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.571833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.588240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 447/890] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:08.589999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.636058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40085b-4f41-4f75-b28e-8e0921cdd0ff None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.655800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.682486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.683227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.683702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.684740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.685477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:08.685989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.687514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.693156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 444/891] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:08.699599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.728424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5fd4e-9770-4bb4-b3d1-267f85355410 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.767845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.769338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.770412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.770905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.787169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.789576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:08.807262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:08.808383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:08.809882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:08.809882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:08.809882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:08.809882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 448/892] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:08.813519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a06d38-2307-4eec-9a21-a6ff9703776c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.816924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.829776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.854682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.855289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.855562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.855832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.857098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:08.857396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.858793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.864022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 445/893] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:08.864818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:08.915531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:08.929079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c2c4-e8cc-45b9-b77c-af6f4e8a20a0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.962323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:08.962934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:08.963208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:08.963478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:08.964132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:08.964443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:08.966294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:08.971413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8edbe4-1dc6-4778-8a3f-6311b437d376 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:08.977812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 449/894] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:08.978606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.005323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d23fe4-a0eb-4794-afb6-b98c0fae104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.005925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d23fe4-a0eb-4794-afb6-b98c0fae104d None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.006202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d23fe4-a0eb-4794-afb6-b98c0fae104d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.006472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d23fe4-a0eb-4794-afb6-b98c0fae104d None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.007112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d23fe4-a0eb-4794-afb6-b98c0fae104d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.008514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d23fe4-a0eb-4794-afb6-b98c0fae104d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.047427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.072745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 446/895] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:08 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:09.074046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc8e9-11fd-410b-9e42-579103b8a22d None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.074340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc8e9-11fd-410b-9e42-579103b8a22d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.074611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc8e9-11fd-410b-9e42-579103b8a22d None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.075857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 447/896] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:09.076633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bc8e9-11fd-410b-9e42-579103b8a22d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.085421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf047f97-0201-4fc6-88be-9c2a9de85527 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.134135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.135094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.135370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.135639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.136421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] RBAC: Adding query filter params (interface=public, service_id=455f489537d24d4d95cc1c8a3310f949, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:09.136730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.138171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8fe57-2f54-4f27-9ef0-0637e43224a7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.147271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 450/897] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 13:00:08 2022] GET /identity/v3/endpoints?service_id=455f489537d24d4d95cc1c8a3310f949&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:09.148693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.148978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.149255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.169417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:09.170698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:09.205753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bc8e9-11fd-410b-9e42-579103b8a22d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.208389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.246682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 451/898] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:09.246898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.247330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.247507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.247750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.248006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.255571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.257648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:09.271912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:09.272946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:09.273905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:09.276493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 448/899] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:09.283183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.319860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.374161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d4a68-935c-4d6f-8867-864abd9370e8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.411202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.412011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.412409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.412765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.413465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.414914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.416500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47724fe0-d6c2-4bb3-a20b-21e7674e8935 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.422086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 452/900] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:00:09.457661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.458573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.459059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.459480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.460458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:09.460912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.462536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.484585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 449/901] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:09.490280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.532677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.568000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.607446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59adb08-6799-4cfb-a37b-8652908c32e2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.636318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.655741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.657082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.657082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.657082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.680207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c024a5-b88e-420e-9027-8f6d649edb16 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.723574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.724530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.724959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.725381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.726193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.727709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:09.737030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:09.738193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:09.739154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:09.746021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 450/902] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:09.747930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.749577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.751346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.839674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:09.859773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab5a90-8fbc-44e2-a634-e8b12fc8c22e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:09.892130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 453/903] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 13:00:09.897278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.900256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:09.901445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:09.901445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:09.901647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:09.902373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:09.903314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:09.905405 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:09.915653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 451/904] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:09.916991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:09.927772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:10.025717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ad22-d616-4c65-abc4-d7d90c7a8c30 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.027344 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36939337-7eb1-486c-8653-5719b8b44521 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.071916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.073043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.073490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.073836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.075273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:10.075651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.077223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.078946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.079817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.080361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.080832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.084223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 452/905] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:10.092829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:10.096450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.098109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.112427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:10.114049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:10.114964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:10.115841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:10.115841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:10.115841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:10.117886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 454/906] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:10.124747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:10.212908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725c635-8661-435b-9f54-f602a520bca5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.229093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:10.255624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34145357-2746-4d75-9309-e8d18f5514d8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.260421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.261041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.261318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.261590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.262315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] RBAC: Adding query filter params (interface=public, service_id=7982b5fe3f8344ca92c835f59eafe9db, region_id=RegionOne) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:10.262619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.263999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.276227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 453/907] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 13:00:10 2022] GET /identity/v3/endpoints?service_id=7982b5fe3f8344ca92c835f59eafe9db&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:10.278747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:10.300043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.301138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.301670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.302143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.303048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:10.303561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.305184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.319297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 455/908] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:10.325345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:10.386993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:10.420515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5db0ac-80ca-499c-9974-3cb1ea283ff4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.450693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16afc2-66df-41db-b39e-5cb0e51ff75e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.456707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.457318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.457590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.457859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.458458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.459818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.467435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 454/909] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:00:10 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:00:10.501656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.502301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.502572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.502834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.505303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:10.511624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.513187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:10.526190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:10.527184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:10.529017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 456/910] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:10.535945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:10.653564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2240592-82f2-4f36-b23f-d47789cd321b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.691894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.692526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.692805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.693074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.693759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:10.694068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.695526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3d777-6a3b-4ecf-9d51-084f29ad9acb None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.712162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 455/911] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:10.714988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:10.825876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884c6fd-3cdb-426d-953e-678f2fe6632e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:10.861200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:10.862189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:10.862679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:10.863156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:10.864072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] RBAC: Adding query filter params (role.id=5054a9c9cc0940fda9ba8d4509a65873, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=3516227f02da4f1b90b74577c1fe1cf6) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:10.864644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:10.866277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79178a6-5431-4748-9e06-3ab54240672a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:10.873486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 457/912] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:10 2022] GET /identity/v3/role_assignments?user.id=3516227f02da4f1b90b74577c1fe1cf6&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=5054a9c9cc0940fda9ba8d4509a65873 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:11.375707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ea05a-ca0d-48ca-aea3-caa82a2bc91c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:11.376278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ea05a-ca0d-48ca-aea3-caa82a2bc91c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:11.376278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ea05a-ca0d-48ca-aea3-caa82a2bc91c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:11.377896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 456/913] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:11.383120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741715-1720-4393-a12c-c621bf568935 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:11.383534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741715-1720-4393-a12c-c621bf568935 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:11.383725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22741715-1720-4393-a12c-c621bf568935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:11.402311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-22741715-1720-4393-a12c-c621bf568935 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:11.404076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-22741715-1720-4393-a12c-c621bf568935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:11.461091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:11.475884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 458/914] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:11.702487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aa1ed-0df7-4e7f-86de-f9510d761180 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:11.702806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aa1ed-0df7-4e7f-86de-f9510d761180 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:11.703031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8aa1ed-0df7-4e7f-86de-f9510d761180 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:11.704608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 457/915] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:11.709866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:11.710148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:11.710417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:11.728627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:11.729804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:11.748935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aa1ed-0df7-4e7f-86de-f9510d761180 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:11.751955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:11.817273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 459/916] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:11.876686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8aa1ed-0df7-4e7f-86de-f9510d761180 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:11.913519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:11.914200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:11.914472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:11.914740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:11.915364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:11.916699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:11.926197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:11.927180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:11.928012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 458/917] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:11.935342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.039704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014a590-d803-4c71-b14b-30c57d37273f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.057218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.076678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:12.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.088905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 460/918] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:12.094493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.104459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.183082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.230194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f099a8-20c4-43d3-a776-d0cd7e40819c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.237117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2fed3-717c-48d2-8052-b91baad370cc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.274989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.276001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.276571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.276846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.277478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:12.277827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.279356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.280361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.281266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.281938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.282207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.283059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.284441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.285007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 459/919] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:12.290514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:12.299961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:12.301121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 07 13:00:12.301962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:12.306595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 461/920] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:12.307871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.371210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.418080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d10508-4b8b-4f22-bc5e-18df96aed929 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.433846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6df3e-070f-43c6-99bd-42158872dd55 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.448406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.454445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.455093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.468155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.468155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.468155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] RBAC: Adding query filter params (interface=public, service_id=aa2dce7292a84640a0c194e5733b6503, region_id=RegionOne) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:12.468155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.468155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.468155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 460/921] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/endpoints?service_id=aa2dce7292a84640a0c194e5733b6503&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:12.469647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.474218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.475047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.475472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.475886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.476699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:12.477161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.478847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.485062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 462/922] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:12.491024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.604210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ee07f-49c1-4c5d-9921-d2872b0c4b19 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.625549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e07fc-9bcd-4376-9051-0a2c7bdba2fb None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.640608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.647969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.648749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.649124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.649700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.653658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.653658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.668108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 461/923] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:00:12.680567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.681225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.681510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.681854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.682615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:12.682928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.685125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030b578-34d5-4db5-9176-bea41177eb18 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.691956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 463/924] 10.222.0.57 () {56 vars in 1114 bytes} [Wed Sep 7 13:00:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:12.698806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:12.772303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:12.819324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a83c-30f5-4782-8df5-c20e140fa2c5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.819681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a83c-30f5-4782-8df5-c20e140fa2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.819880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5a83c-30f5-4782-8df5-c20e140fa2c5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.821281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d698e-96b5-4713-a7af-fe35b9f11386 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:12.821706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 464/925] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:12.827186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142929-1a24-4879-a7b9-ba06dc2dec50 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.827787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142929-1a24-4879-a7b9-ba06dc2dec50 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.828333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0142929-1a24-4879-a7b9-ba06dc2dec50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.849168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d0142929-1a24-4879-a7b9-ba06dc2dec50 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:12.850785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d0142929-1a24-4879-a7b9-ba06dc2dec50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:12.862622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607d1f6-f61b-430e-92cd-80cd4c96c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:12.863238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d1f6-f61b-430e-92cd-80cd4c96c6df None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:12.863517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d1f6-f61b-430e-92cd-80cd4c96c6df None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:12.863792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d1f6-f61b-430e-92cd-80cd4c96c6df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:12.864608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d1f6-f61b-430e-92cd-80cd4c96c6df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:12.865988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607d1f6-f61b-430e-92cd-80cd4c96c6df None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:12.932115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 465/926] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:12.955101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 462/927] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:00:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:13.117741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315e2dd-1bb7-4844-bf00-b4c7f043e03c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.118073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315e2dd-1bb7-4844-bf00-b4c7f043e03c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.118298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315e2dd-1bb7-4844-bf00-b4c7f043e03c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.119874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 466/928] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:13.125676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.126256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.126800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.146988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:13.148524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:13.210044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315e2dd-1bb7-4844-bf00-b4c7f043e03c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.228304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 463/929] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:13.317987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315e2dd-1bb7-4844-bf00-b4c7f043e03c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.320494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.357554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.358193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.358474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.358741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.359463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.361010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:13.370807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:13.372607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:13.373932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 467/930] 10.222.0.57 () {56 vars in 1132 bytes} [Wed Sep 7 13:00:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:13.379126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.422824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.483298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab6141-aab7-4ce4-b939-05409cd853ad None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.522513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.523191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.523305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.523714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.523714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.528712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:13.528712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.528712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.538244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 464/931] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:13.543945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.660672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b977d-3b43-42e0-8683-db66dbff5555 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.671578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5bf0e-19ab-4aa2-9c23-621b993e99e0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.674794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.700331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.701692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.702220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.702663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.711954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.712868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.713149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.713413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.714032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:13.714328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.716515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.716974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:13.727107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 465/932] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:13.727282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:13.728167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:13.729013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:13.731686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 468/933] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 7 13:00:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:13.732599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.733408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.770272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:13.854140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af17eb1-88c0-4b49-8d91-b2d2bd68e195 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.854850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd061d1-713e-4337-ab65-1063c152ba04 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:13.894173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.895402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.896266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:13.896468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.896725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.897398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.897679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:13.898158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:13.898617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:13.898783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.899635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:13.900168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:13.901888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:13.913206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 469/934] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:00:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:13.919162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:13.992627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 466/935] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:00:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:00:14.032074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:14.045209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6841ba-ef3a-4b18-999f-c8ed0b3927c8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:14.094180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:14.095214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.095773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.096274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.109184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:14.111038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:14.129124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:14.130140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:14.131030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:14.131030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:14.131030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:14.133253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 470/936] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:14.140138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:14.170077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:14.251115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c8497-a60c-40d8-829a-8fa46b9fe32a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:14.288385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:14.289400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.289901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.290383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.291224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:14.291724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:14.293331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:14.306426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 467/937] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:14.312330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:14.422821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f4dc1-c7ed-41e1-833a-30218a5fa797 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:14.459130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:14.460145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.460648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.461125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.470013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:14.471746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:14.473791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:14.485503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:14.493794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:14.494744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 471/938] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:00:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:14.495343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:14.585350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:14.601328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c6a20-b9df-44a6-b41e-daf53cee1c02 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:14.637724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:14.638389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.638679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.638954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.639687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:14.639993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:14.641566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:14.661591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 468/939] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 7 13:00:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:14.667302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:14.777027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69b6e0-512f-4ea5-b699-048fa32e7b27 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:14.818950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:14.819661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.820017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.820330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.833270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:14.834732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-51697df1-4872-4359-a2c1-02777b024744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:14.857689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:14.858805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:14.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:14.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:14.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:14.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 472/940] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:14.864713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:14.947341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e356-a823-480b-9832-e19320db085d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.947685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e356-a823-480b-9832-e19320db085d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.947891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8e356-a823-480b-9832-e19320db085d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.949405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 473/941] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:14.955456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:14.956182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:14.956763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:14.981054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c96927-2b41-4d2d-8451-0d2a1594bd00 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:14.981297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:14.983165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:15.025425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.026031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.026315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.026896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.028347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:15.028655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.030028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.044124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 469/942] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:15.049477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.052447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.053837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.076710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 474/943] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:15.170816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2690e-0310-473f-8f3a-ba62eb71b2d8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.211293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e32118-779f-4199-8815-6894ac877232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.211926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e32118-779f-4199-8815-6894ac877232 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.212238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e32118-779f-4199-8815-6894ac877232 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.212514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e32118-779f-4199-8815-6894ac877232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.220738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e32118-779f-4199-8815-6894ac877232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.222241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e32118-779f-4199-8815-6894ac877232 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-24e32118-779f-4199-8815-6894ac877232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:15.234131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:15.235025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.235917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 470/944] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:15.241508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.255270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5d56-c220-4065-ac9a-73bee70e028b None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.255575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5d56-c220-4065-ac9a-73bee70e028b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.255846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d5d56-c220-4065-ac9a-73bee70e028b None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.257573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 471/945] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:15.263647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a732-2d53-4091-8652-e7442829effa None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.263930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a732-2d53-4091-8652-e7442829effa None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.264238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45a732-2d53-4091-8652-e7442829effa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.284392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4f45a732-2d53-4091-8652-e7442829effa None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:15.285620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4f45a732-2d53-4091-8652-e7442829effa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:15.354433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.358011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc8e49-5cfc-43cc-968c-9f52edf2e964 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.372221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 472/946] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:15.395583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.396254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.396659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.396942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.397640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:15.397947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.399372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.411822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 475/947] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:15.417749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45a732-2d53-4091-8652-e7442829effa None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.426262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.488680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.536196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45a732-2d53-4091-8652-e7442829effa None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.559467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cabcd9-5191-4a5d-8b48-c97abb72bae3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.583861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.584809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.585092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.585367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/3516227f02da4f1b90b74577c1fe1cf6/roles/5054a9c9cc0940fda9ba8d4509a65873` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.588237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=3516227f02da4f1b90b74577c1fe1cf6, role_id=5054a9c9cc0940fda9ba8d4509a65873)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.590514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.598270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.598971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.599315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.599668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.600353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.601767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:15.610785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:15.613290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:15.614149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 476/948] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:15.617779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.679330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 473/949] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:00:15 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/3516227f02da4f1b90b74577c1fe1cf6/roles/5054a9c9cc0940fda9ba8d4509a65873 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:00:15.680460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.738454 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871595b-7e3b-49d9-a0dc-59dea752e9f8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.742240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.761665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:15.789928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.789928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.789928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.790314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.790961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:15.791271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.792730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.804117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 477/950] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:15.805363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.834294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e27be7-618d-4ea5-abf9-0d53c134f806 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.875684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.876099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.876288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.876559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.877214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.878672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:15.881391 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING keystone.server.flask.common [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 07 13:00:15.938998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155ec48-4212-4c16-aeeb-e9470389c823 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:15.957077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.sql.core [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 13:00:15.957077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 13:00:15.957077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [parameters: {'id': 'eafd31eb156d4e549e78c19f09930de6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 13:00:15.957077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81818) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eafd31eb156d4e549e78c19f09930de6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eafd31eb156d4e549e78c19f09930de6. Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application conn.query(q) Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 13:00:15.973028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result.read() Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 07 13:00:15.973943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application next(self.gen) Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application yield resource Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application next(self.gen) Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise self.value Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application session.commit() Sep 07 13:00:15.974927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.session.flush() Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application compat.raise_( Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 13:00:15.975869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 13:00:15.976843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application conn.query(q) Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result.read() Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 13:00:15.977683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [parameters: {'id': 'eafd31eb156d4e549e78c19f09930de6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.978550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:15.979334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eafd31eb156d4e549e78c19f09930de6. Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 474/951] 10.222.0.57 () {60 vars in 1140 bytes} [Wed Sep 7 13:00:15 2022] POST /identity/v3/projects => generated 262 bytes in 294 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:15.982631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:15.995526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:15.996248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:15.996678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:15.996952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:15.997784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:15.998113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:15.999544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.006075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 478/952] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:16.011656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:16.047480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.112775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d819813-9783-4644-9951-12a44607ce41 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:16.123775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.137794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92adfa-aa03-4657-ade1-0edd874dc15b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:16.152793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:16.154157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.154660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.155072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.164315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:16.166580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.178754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5dac9-4de8-4771-a2ad-66e1498823e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:16.179548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5dac9-4de8-4771-a2ad-66e1498823e3 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.179931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5dac9-4de8-4771-a2ad-66e1498823e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.180337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5dac9-4de8-4771-a2ad-66e1498823e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.181139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5dac9-4de8-4771-a2ad-66e1498823e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:16.182180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:16.183363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:16.184595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:16.185209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5dac9-4de8-4771-a2ad-66e1498823e3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.187027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 475/953] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:16.193326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:16.264131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 479/954] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:00:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:00:16.303908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cd56e-f354-4706-b8e3-50c75de3daaa None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.304255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cd56e-f354-4706-b8e3-50c75de3daaa None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.304492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cd56e-f354-4706-b8e3-50c75de3daaa None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.310336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 480/955] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:16.312275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.312570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.312912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.331562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d10c1-94e8-4b09-9b2c-74832f591a01 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:16.334308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:16.336676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:16.392319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:16.393263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.393989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.394852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.395721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:16.396551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:16.398803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.422933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 476/956] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:16 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:16.432363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 481/957] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:16.713285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:16.739675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.817758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c21c0-90fc-481b-ae76-bf941ab140a4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:16.852411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:16.853049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:16.853323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:16.853594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:16.854236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:16.855646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:16.865078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:16.866155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:16.867032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 477/958] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:16.875048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:16.900485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:16.979044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2effa-9bb1-48c2-9eb6-22a59790cd3b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:17.016378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:17.017029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:17.017475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:17.017896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:17.019414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:17.019907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:17.021815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2fcaf0-6507-49c2-8dc6-d70f13a1ba70 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:17.027408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 482/959] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:17.033611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:17.131903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:17.144913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afde0-4ca7-480a-8539-1e7387ef4013 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:17.180655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:17.181262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:17.181539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:17.181807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:17.182435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:17.182734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:17.184680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4377ebf-50ab-4cf9-862d-cb605ae9a53c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:17.189924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 478/960] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:17.908810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeed06a-8777-4612-a8f4-70e1ff557be0 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:17.909345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeed06a-8777-4612-a8f4-70e1ff557be0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:17.909345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeed06a-8777-4612-a8f4-70e1ff557be0 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:17.910965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 483/961] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:17.916498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:17.916918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:17.916996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:17.938150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:17.939650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:18.009886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 479/962] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:18.280141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeed06a-8777-4612-a8f4-70e1ff557be0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:18.368607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:18.388942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeed06a-8777-4612-a8f4-70e1ff557be0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:18.424042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:18.424744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.425434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.425768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.437171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:18.442016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:18.442944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:18.443768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 484/963] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 7 13:00:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:18.449464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:18.540739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:18.559098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876123d-e3d1-41bc-ab1c-c1aaf591d5f7 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:18.594917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:18.595527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.595804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.596076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.596768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:18.597068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:18.598532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0a3b8-6db5-479a-9024-b168c610b845 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:18.607358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 480/964] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:00:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:18.613185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:18.631638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d028ae-1a3a-424d-b7d1-c0a4a635b5b8 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.631969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d028ae-1a3a-424d-b7d1-c0a4a635b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.632266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d028ae-1a3a-424d-b7d1-c0a4a635b5b8 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.633846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 481/965] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:18.642408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720270a-e99c-42b3-8b6e-479e123edd05 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.642408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720270a-e99c-42b3-8b6e-479e123edd05 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.642408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720270a-e99c-42b3-8b6e-479e123edd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.666322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1720270a-e99c-42b3-8b6e-479e123edd05 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:18.667025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1720270a-e99c-42b3-8b6e-479e123edd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:18.758390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bb6bd-210d-4a35-ab69-19e630f64980 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:18.772171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 482/966] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:18.777860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729644d-0dbd-4604-9ad0-e8d8c5f85bfc None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.778149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729644d-0dbd-4604-9ad0-e8d8c5f85bfc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.778424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729644d-0dbd-4604-9ad0-e8d8c5f85bfc None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.783744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 483/967] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:18.784903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.785188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.785467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.800986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:18.801595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.801938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.802125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.807483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:18.808771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:18.814202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:18.815281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:18.817669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:18.833358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:18.834335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:18.835231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:18.835231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:18.835231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:18.835231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 485/968] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:18.841313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:18.899514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 484/969] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:18.951898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3a3e4-950a-4ccd-9d76-d343ce3402ee None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:18.988019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:18.988942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:18.989401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:18.989866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:18.990747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:18.991223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:18.992822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.006498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 486/970] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:19.011814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.016372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.071082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.130347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880517b-e3a2-4438-8655-32fefcf3ef99 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.133734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.179316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.180420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.180843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.181213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.186822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb03ab7-61e7-414d-bcf2-29fc4304d648 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.192034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.193647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:19.209675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:19.210667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 07 13:00:19.211644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:19.213869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 485/971] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:19.213869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.227596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.228271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.228548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.228814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.229394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.230743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:19.240141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:19.241224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:19.242088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 487/972] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:19.243387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.287945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.331504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499062d-6e63-46fc-824d-45de9e0a7857 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.355189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b3ad9-fae8-4cf7-887e-5fd81bf5b5f5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.369331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.370059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.370331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.370595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.371234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.373371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.373845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.391327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.399249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.399249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.399249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.399249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:19.399249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.399249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.412783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 488/973] 10.222.0.57 () {56 vars in 1149 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:19.413613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.442865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.sql.core [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 13:00:19.442865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 13:00:19.442865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [parameters: {'user_id': '1fb5fd19e26340fdb3ecfcf78ee08247', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 13:00:19.442865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81818) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application conn.query(q) Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result.read() Sep 07 13:00:19.450292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 13:00:19.451223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application next(self.gen) Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application yield resource Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application next(self.gen) Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.session.rollback() Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.force_reraise() Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise self.value Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application session.commit() Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 07 13:00:19.452216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._prepare_impl() Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.session.flush() Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._flush(objects) Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application compat.raise_( Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application flush_context.execute() Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rec.execute(self) Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 07 13:00:19.453127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 07 13:00:19.454046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result = self._query(query) Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application conn.query(q) Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application result.read() Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 07 13:00:19.454914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [parameters: {'user_id': '1fb5fd19e26340fdb3ecfcf78ee08247', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:19.455901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 07 13:00:19.456740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 486/974] 10.222.0.57 () {60 vars in 1131 bytes} [Wed Sep 7 13:00:19 2022] POST /identity/v3/users => generated 160 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:19.457660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.518194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5213-48dd-49bc-badb-9456550ee383 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.552970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.553587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.554001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.554285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.555047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:19.555350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.556755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e25d10-0b4b-45fc-9640-ddc6c7dbc6be None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.561935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 489/975] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:19.562712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb54a8b-98f9-44e4-a94b-58896ade7773 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.563161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881d8f-6ab9-4f9e-b4ce-650293d6c957 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.563446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881d8f-6ab9-4f9e-b4ce-650293d6c957 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.563751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76881d8f-6ab9-4f9e-b4ce-650293d6c957 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.564989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 490/976] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:19.565690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881d8f-6ab9-4f9e-b4ce-650293d6c957 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.592395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.600961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340e86a-2c7f-4ece-9626-039cabdd4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.601567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e86a-2c7f-4ece-9626-039cabdd4081 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.605267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e86a-2c7f-4ece-9626-039cabdd4081 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.605267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340e86a-2c7f-4ece-9626-039cabdd4081 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.610227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.668758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76881d8f-6ab9-4f9e-b4ce-650293d6c957 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.672939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340e86a-2c7f-4ece-9626-039cabdd4081 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.674603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340e86a-2c7f-4ece-9626-039cabdd4081 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.705983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.706613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.706964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.707233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.715322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.717476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:19.730401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:19.731881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:19.732884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 491/977] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:19.733481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.783574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 487/978] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:00:19.784962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.785253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.785517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.804133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:19.805679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:19.826278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.829623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:19.832880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d42bca-5686-4519-a1b9-5349d3a2db65 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.872296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:19.873180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:19.873496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:19.873765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:19.874392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:19.874692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:19.874928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 488/979] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:19.875780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.876170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:19.886301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 492/980] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:19.886301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:19.985804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04916d62-3428-4c0b-b9ff-e4c160674a15 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:19.992919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3232d0-445f-418a-9459-373eb8fab806 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.025413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.026024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.026304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.026573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.027269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:20.027562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.029221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.030801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.031615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.032047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.032486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.044045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.045684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:20.060696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:20.061736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:20.062767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:20.062767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:20.062767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:20.064424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 493/981] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:20.065362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.068116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 489/982] 10.222.0.57 () {56 vars in 1101 bytes} [Wed Sep 7 13:00:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:20.069659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.087670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:20.108535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:20.193373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5c72d-8dc1-4b84-a4d6-fa5f63ad9aa7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.217415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec599161-3bc1-4c8c-80f1-e927148e1bd5 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.241777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.242047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.242471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.242471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.243140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:20.243443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.245290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.259195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 490/983] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:20.261059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.270612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.270612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.271023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.271187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.272009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] RBAC: Adding query filter params (interface=admin, service_id=aa2dce7292a84640a0c194e5733b6503, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:20.273008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.274863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.280557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 494/984] 10.222.0.57 () {56 vars in 1249 bytes} [Wed Sep 7 13:00:20 2022] GET /identity/v3/endpoints?service_id=aa2dce7292a84640a0c194e5733b6503&interface=admin®ion_id=RegionOne => generated 193 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:20.282208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.353502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:20.369694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:20.379141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c159fc6-17e0-405e-aa0a-3f84158c0602 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.389315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29bbf0-bdec-4d93-a61f-4e96bde91b7c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.413333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.413936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.414210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.416261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.416261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.416543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.423631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.424285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.424557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.424821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.431302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.432734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:20.444687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:20.451042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 495/985] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:20.452249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.496771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 491/986] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:20 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:20.497694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.560285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3582016-90a9-4851-be6e-ae46df0dd1c2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.608178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.608908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.609177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.609554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.610164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.611673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.614017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:20.619179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0ca5c-7ed9-4a06-9950-a3217a6506fe None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.632130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 496/987] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:00:20 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:00:20.677842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.678560 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.678912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.679276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.680070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:20.680416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.681907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ca225-88d8-4ba4-aef6-10af3e0a5276 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.684251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:20.703039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 492/988] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:20.703725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:20.818640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831b3bf-3315-4629-a75a-0105c4ce323d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:20.853409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:20.854021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:20.854297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:20.854566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:20.855284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] RBAC: Adding query filter params (role.id=5054a9c9cc0940fda9ba8d4509a65873, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=3516227f02da4f1b90b74577c1fe1cf6) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:20.855605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:20.857069 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819899e8-8978-4e30-84f8-7131f56a7b3d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:20.863127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 497/989] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:20 2022] GET /identity/v3/role_assignments?user.id=3516227f02da4f1b90b74577c1fe1cf6&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=5054a9c9cc0940fda9ba8d4509a65873 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:22.706594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542716e9-0798-4bde-897b-957bde2f9f36 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:22.707157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542716e9-0798-4bde-897b-957bde2f9f36 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:22.707157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542716e9-0798-4bde-897b-957bde2f9f36 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:22.708784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 493/990] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:22.714386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab187c-ab9c-4fea-be66-5e903c02682b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:22.714886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab187c-ab9c-4fea-be66-5e903c02682b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:22.714987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab187c-ab9c-4fea-be66-5e903c02682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:22.734428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a1ab187c-ab9c-4fea-be66-5e903c02682b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:22.735605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a1ab187c-ab9c-4fea-be66-5e903c02682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:22.796826 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:22.805175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 498/991] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:22.816130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1d4f-7ec6-41b5-bc4b-b69d424108ed None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:22.816413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1d4f-7ec6-41b5-bc4b-b69d424108ed None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:22.816689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa1d4f-7ec6-41b5-bc4b-b69d424108ed None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:22.818164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 494/992] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:22.823405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64168267-938a-420c-97a8-3d81439c12ce None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:22.823692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64168267-938a-420c-97a8-3d81439c12ce None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:22.823967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64168267-938a-420c-97a8-3d81439c12ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:22.843662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-64168267-938a-420c-97a8-3d81439c12ce None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:22.844884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-64168267-938a-420c-97a8-3d81439c12ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:22.913230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 499/993] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:23.085342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1d4f-7ec6-41b5-bc4b-b69d424108ed None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.085877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731359d1-2c3a-42cf-b676-35bc33937c62 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.086159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731359d1-2c3a-42cf-b676-35bc33937c62 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.086426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731359d1-2c3a-42cf-b676-35bc33937c62 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.087906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 500/994] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:23.093162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.093439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.093707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.112568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:23.113746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:23.183285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 501/995] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:23 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:23.184670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.191017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa1d4f-7ec6-41b5-bc4b-b69d424108ed None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.230643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.231334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.231649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.231874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.232602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.233838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.241935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:23.243109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:23.244336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:23.245255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 495/996] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:23.250358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.292653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01a962-f6c8-46f8-ba30-de969c0c40cc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.310024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.328586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.329226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.329511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.329783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.330367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.331724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:23.340540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:23.342529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:23.344014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 502/997] 10.222.0.57 () {56 vars in 1126 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:23.347985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.364455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c76a7-20ce-46db-a7fd-92ec99d74f19 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.402805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.403457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.403741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.404013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.404680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:23.405125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.406500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.411732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 496/998] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:23.417517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.459110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a462ef-842e-4877-aecf-895fc6a91cee None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.477146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.493840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.496210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.496210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.496210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.496210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:23.496210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.497279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.501911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 503/999] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:23.502672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.526145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7231b-683f-439e-964c-6526a81f9cf7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.572040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.583931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.584563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.584839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.585104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.585718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:23.586014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.587412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.602928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 497/1000] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:23.602928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.669805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ab59a-359f-4ea4-b506-775668100b57 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.703385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.703853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82580cbc-a8dd-4425-a12a-7fb00c411804 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.704032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.704310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.704591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] PATH_INFO: `/v3/services/image` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.705170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.706520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:23.715795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:23.717258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:23.718105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 504/1001] 10.222.0.57 () {56 vars in 1105 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:23.718938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.738823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.739430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.739699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.739960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.740616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:23.740909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.742287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.748135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 498/1002] 10.222.0.57 () {56 vars in 1122 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:23.749298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.770153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.800529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.823479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a8294-aa7a-46a1-92c8-03e96169cadf None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.849873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b07064-9629-49cc-ae9e-8d134902ca15 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.859012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.859555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.859835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.860126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.860828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] RBAC: Adding query filter params (interface=public, service_id=703f1e22ede546bc933ed0e4da09ef82, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:23.861125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.862470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.867619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 505/1003] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/endpoints?service_id=703f1e22ede546bc933ed0e4da09ef82&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:23.868434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.886088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:23.886696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:23.886987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:23.887847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:23.888509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] RBAC: Adding query filter params (name=image) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:23.888811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:23.890188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:23.895521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 499/1004] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:23.896452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:23.972137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da7999-45db-4862-be7e-a3a0184f4031 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:23.982642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:23.995273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1cd1f-da3f-40cf-a9c7-3228a1139b15 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:24.006170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda553f8-2133-47ee-9dcb-e1f031d34244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:24.006781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda553f8-2133-47ee-9dcb-e1f031d34244 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:24.007058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda553f8-2133-47ee-9dcb-e1f031d34244 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:24.007329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda553f8-2133-47ee-9dcb-e1f031d34244 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:24.007986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda553f8-2133-47ee-9dcb-e1f031d34244 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:24.009536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda553f8-2133-47ee-9dcb-e1f031d34244 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:24.010379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:24.031358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:24.032004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:24.032302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:24.032573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:24.033167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:24.034519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:24.040682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 500/1005] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:00:23 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:00:24.041513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:24.078755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 506/1006] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:00:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:24.171680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e2e59-38e5-43e8-95bc-385f5555c128 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:24.218132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:24.218753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:24.219021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:24.219282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:24.219921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:24.220256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:24.221681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7099bc-1412-4b1e-86e2-169241c1dac7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:24.227240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 501/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:26.244345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451cf6-5b49-47c0-8cb8-2ca46ea08920 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.244932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451cf6-5b49-47c0-8cb8-2ca46ea08920 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.244932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39451cf6-5b49-47c0-8cb8-2ca46ea08920 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.246970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 507/1008] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:26.252876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc02b1-7bb2-4f0c-8a85-e1fd184cc076 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.253417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc02b1-7bb2-4f0c-8a85-e1fd184cc076 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.253417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc02b1-7bb2-4f0c-8a85-e1fd184cc076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.273193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c6fc02b1-7bb2-4f0c-8a85-e1fd184cc076 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:26.274425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c6fc02b1-7bb2-4f0c-8a85-e1fd184cc076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:26.304713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a70ed-c792-44fe-bc56-74834e7aa6f9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.305029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a70ed-c792-44fe-bc56-74834e7aa6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.305266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a70ed-c792-44fe-bc56-74834e7aa6f9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.307001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 508/1009] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:26.307136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:26.311624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.311906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.312203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.330986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:26.332218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:26.345877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 502/1010] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:26.374492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26039-3f24-435e-95b3-dfbb0ed94a88 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.374782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26039-3f24-435e-95b3-dfbb0ed94a88 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.375095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc26039-3f24-435e-95b3-dfbb0ed94a88 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.376544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 503/1011] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:26.381307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.381570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.381842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.405375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:26.407207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:26.412885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 509/1012] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:26.480135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 504/1013] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:26.618722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:26.682518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:26.732280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:26.735664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f1f1b-b8fd-4bcc-b8c9-229666672cb7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:26.771751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:26.772422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.772696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.772965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.773545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:26.774905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:26.784358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:26.785354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:26.786225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 510/1014] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:26.787061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:26.787136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:26.791760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c738ed9-266a-48ed-ad5e-b79174dea870 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:26.825453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:26.826082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.826377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.826693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.827797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:26.829263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:26.830854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 505/1015] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:26.831628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:26.885749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5ebd-4e92-4eaa-a2ed-c0fc7e2a057d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:26.919377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:26.919979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.920286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.920557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.921193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:26.922545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:26.932629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219dfeed-9a74-43c7-b4d5-8d75c2e3a429 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:26.967170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:26.967768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:26.968050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:26.968353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:26.968970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:26.969273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:26.970641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:26.975254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 506/1016] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:26.976103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:27.012701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 511/1017] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:26 2022] POST /identity/v3/services => generated 242 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:27.012701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:27.013603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:27.036033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:27.085983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea984f6-4385-4fa4-a895-34e50d809972 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:27.126260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2597-67b8-4df2-bc3d-4420a73483e0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:27.131576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca69c1-1918-4d7b-9a62-83416c43f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:27.132242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca69c1-1918-4d7b-9a62-83416c43f9a9 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:27.132520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca69c1-1918-4d7b-9a62-83416c43f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:27.132789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca69c1-1918-4d7b-9a62-83416c43f9a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:27.133449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca69c1-1918-4d7b-9a62-83416c43f9a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:27.134925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca69c1-1918-4d7b-9a62-83416c43f9a9 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:27.167401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:27.167938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:27.168280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:27.168549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:27.169256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:27.169551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:27.170928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:27.177267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 512/1018] 10.222.0.57 () {56 vars in 1112 bytes} [Wed Sep 7 13:00:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:27.181963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:27.247518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 507/1019] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:26 2022] POST /identity/v3/projects => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:27.275270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:27.292600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578464ed-7370-40a5-8eb4-8470f163ef03 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:27.331440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb160528-b3e6-4b9e-bc20-413fda94b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:27.332058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb160528-b3e6-4b9e-bc20-413fda94b6c7 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:27.332357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb160528-b3e6-4b9e-bc20-413fda94b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:27.332622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb160528-b3e6-4b9e-bc20-413fda94b6c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:27.333311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb160528-b3e6-4b9e-bc20-413fda94b6c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:27.334694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb160528-b3e6-4b9e-bc20-413fda94b6c7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:27.412071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 513/1020] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:00:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:00:29.220375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be4c12-b79e-4d09-97d4-36cb1de2d548 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.220920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be4c12-b79e-4d09-97d4-36cb1de2d548 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.220920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be4c12-b79e-4d09-97d4-36cb1de2d548 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.222331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 508/1021] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:29.227418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb1e7-940a-4525-a650-4b3ec0e382ee None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.227811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb1e7-940a-4525-a650-4b3ec0e382ee None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.227988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009cb1e7-940a-4525-a650-4b3ec0e382ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.247157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-009cb1e7-940a-4525-a650-4b3ec0e382ee None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:29.248382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-009cb1e7-940a-4525-a650-4b3ec0e382ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:29.320936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 514/1022] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:29.474340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c1e7-4643-41f3-964b-b7e7c913acec None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.474514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c1e7-4643-41f3-964b-b7e7c913acec None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.474790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96c1e7-4643-41f3-964b-b7e7c913acec None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.476312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 509/1023] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:29.482184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df311e-1633-4c00-8ee3-8e40552d7f9b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.482466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df311e-1633-4c00-8ee3-8e40552d7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.482738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df311e-1633-4c00-8ee3-8e40552d7f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.501313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e1df311e-1633-4c00-8ee3-8e40552d7f9b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:29.502507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e1df311e-1633-4c00-8ee3-8e40552d7f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:29.572369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:29.581506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 515/1024] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:29.596640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c1e7-4643-41f3-964b-b7e7c913acec None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:29.688961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:29.693623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93570f58-8b04-4fdb-a02d-855c85d49fb5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.693900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93570f58-8b04-4fdb-a02d-855c85d49fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.694162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93570f58-8b04-4fdb-a02d-855c85d49fb5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.695644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 516/1025] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:29.700661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.705143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.705143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.712750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96c1e7-4643-41f3-964b-b7e7c913acec None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:29.719165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:29.720401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:29.749687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:29.750261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.750529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.750799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] PATH_INFO: `/v3/services/image` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.751478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:29.752934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:29.761575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:29.763150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:29.764028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 510/1026] 10.222.0.57 () {56 vars in 1105 bytes} [Wed Sep 7 13:00:29 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:29.770035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:29.797470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 517/1027] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:29.853651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:29.881776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8f08-27d9-4376-b7c3-35041cbed32c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:29.920174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:29.920904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:29.921180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:29.921453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:29.922138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] RBAC: Adding query filter params (name=image) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:29.922445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:29.923817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:29.933464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 511/1028] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:29.934751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:29.944188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:29.956019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d0af4-6f97-4120-b977-4650d0cab1dc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:29.986193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:29.997683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:29.998654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.000456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.000456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.000640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.001956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.003686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 518/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:30.009030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.041544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633eb4a-9183-4ff3-be6c-162feb3cdd21 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.077327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.077935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.078210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.078486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.079106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] RBAC: Adding query filter params (type=image) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:30.079408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.080826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.085723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 512/1030] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:30.086500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.114897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf5b37-ace0-4058-b255-1a8ec6fae626 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.149138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.149745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.150019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.150288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.150934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.152386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.156621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:30.187031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e746e-b768-47c3-8f06-076acd0daa2b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.221701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.222356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.222631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.222901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.233545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:30.239312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:30.240484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 513/1031] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:30.241737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.292200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 519/1032] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 13:00:30 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:00:30.292200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.334408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:30.352068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44358d26-a521-4df6-9ea2-59c50ba2bf36 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.382967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:30.389418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.390047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.390325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.390597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.391314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] RBAC: Adding query filter params (interface=public, service_id=6fde09249c4b4ac59c42c2af55b2c9ae, region_id=RegionOne) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:30.391621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.393135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.396110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c689d-73a5-4823-9fee-c0392cf34fab None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.400137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 514/1033] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/endpoints?service_id=6fde09249c4b4ac59c42c2af55b2c9ae&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:30.405330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.440585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.441211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.441486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.441757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.442424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:30.442727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.444468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.458219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 520/1034] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:30.463393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.522911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9637-3c2f-4aa2-a18b-fd6b547904d8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.562012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.562538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.562814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.563085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.563685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.565083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.571568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 515/1035] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:00:30.621128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623375bc-8d58-47fe-bde5-0543ccaccbf1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.638326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:30.665582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.666065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.666344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.666616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.678835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.680377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:30.697362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:30.698407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:30.699289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:30.699289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:30.699289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:30.699289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 521/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:30.706467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.771758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:30.815375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516b19-89d7-45ae-8db3-cbeed9ea592d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:30.850099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:30.850780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:30.851101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:30.851371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:30.852002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:30.852317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:30.853679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:30.866270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 516/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:30.872199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:30.979698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b10c2-f2bb-4330-a444-3f4472480ee6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:31.014995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:31.015630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.015901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.016186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.024527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:31.025968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:31.038189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:31.039194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:31.045276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 522/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 13:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:31.045933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:31.149710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3e21d-aeea-4504-bf23-9934af07b8de None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:31.167541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:31.184569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:31.185173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.185450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.185721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.186442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:31.186751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:31.188195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:31.210847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 517/1039] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 13:00:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:31.212455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:31.239722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:31.316706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23098f6-87c7-408d-a061-614ba36adba6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:31.390079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:31.390079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.390079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.390079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.434277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:31.435655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:31.460695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:31.544279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 523/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:31 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 13:00:31.546711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:31.657122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2119b75-123d-4d7b-b365-9ba25902602e None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:31.695736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:31.696317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.696590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.696852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.707184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:31.708648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:31.723503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:31.724847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:31.726351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:31.726351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:31.726351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:31.726351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 518/1041] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:31.730366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:31.842343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaf431-5cfc-4215-b228-fea8e9645459 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:31.864895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:31.876234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:31.876858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:31.877123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:31.877479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:31.878123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:31.878422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:31.879785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:31.897038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 524/1042] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:31.898282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:31.927239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:31.998388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9677f-cb70-428a-8a25-191e1bd78acb None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:32.033016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:32.033952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.034431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.034900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.041678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:32.043336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:32.054398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:32.055278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:32.056237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:32.062206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 519/1043] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:32.063405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:32.172671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe82fd3-5faa-4867-b1e1-3332474214a4 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:32.209902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:32.210515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.210794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.211061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.211748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:32.212051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:32.213502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5787-e309-4296-adf9-4c17ff58dbd1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:32.230435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 525/1044] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:32.231621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:32.320888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:32.333737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52330a5-d2c0-47af-bd94-42b05c751aac None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:32.367033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:32.367636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.367914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.368214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.368942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] RBAC: Adding query filter params (role.id=5054a9c9cc0940fda9ba8d4509a65873, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=08d7cfc07ef940b99652044bc7879601) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:32.369255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:32.370700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf4761-fb6a-4b00-ad70-f1eeb3f5d37d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:32.384124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 520/1045] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:32 2022] GET /identity/v3/role_assignments?user.id=08d7cfc07ef940b99652044bc7879601&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=5054a9c9cc0940fda9ba8d4509a65873 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:32.562315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9407e-22a1-4ef3-aa2f-ac99b2b38315 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.562852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9407e-22a1-4ef3-aa2f-ac99b2b38315 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.562852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9407e-22a1-4ef3-aa2f-ac99b2b38315 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.564483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 526/1046] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:32.569971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ba3-4dae-490e-a723-ab3eb6402693 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.570517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ba3-4dae-490e-a723-ab3eb6402693 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.570609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a9ba3-4dae-490e-a723-ab3eb6402693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.589111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-2a1a9ba3-4dae-490e-a723-ab3eb6402693 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:32.590845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2a1a9ba3-4dae-490e-a723-ab3eb6402693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:32.674938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 521/1047] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:32.755707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2aca-964b-4b59-bfb3-2133f7946e87 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.756062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2aca-964b-4b59-bfb3-2133f7946e87 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.756299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d2aca-964b-4b59-bfb3-2133f7946e87 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.757791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 527/1048] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:32.763462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:32.763780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:32.764056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:32.782850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:32.784036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:32.856355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 522/1049] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:32.946825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d2aca-964b-4b59-bfb3-2133f7946e87 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:32.995624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.052262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d2aca-964b-4b59-bfb3-2133f7946e87 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.084901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.085530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.085802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.086066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.097961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:33.102709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:33.104906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:33.107260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 528/1050] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:00:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:33.110371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.127181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.128209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.221354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11c594-cbc8-42b6-87be-569d96aa1508 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.235817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934475-5c8a-4922-8c05-06f6f0195a1e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.238176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.258166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d890-9b39-4269-a402-b66974600cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.259102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d890-9b39-4269-a402-b66974600cab None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.259527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d890-9b39-4269-a402-b66974600cab None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.259944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d890-9b39-4269-a402-b66974600cab None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.260975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d890-9b39-4269-a402-b66974600cab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:33.261460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d890-9b39-4269-a402-b66974600cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.263596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498d890-9b39-4269-a402-b66974600cab None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.272181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.273031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.273477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.274054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.274640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.279632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 523/1051] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:33.279789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.280770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d890-9b39-4269-a402-b66974600cab None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:33.287580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:33.288617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 07 13:00:33.289575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:33.292409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 529/1052] 10.222.0.57 () {56 vars in 1105 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:33.295064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.364101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.396232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d890-9b39-4269-a402-b66974600cab None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.399414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23ab7-0e2a-4fa7-9ef9-ff35e02beaf3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.434910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.435141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.445415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.445548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.445628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.445699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.445784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] PATH_INFO: `/v3/users/5a3497accb3b42c4b025ade165e3bd1a` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.445864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.445864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] RBAC: Adding query filter params (name=image) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:33.445864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.445864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.445864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 530/1053] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:33.449492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.451201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] RBAC: Authorizing `identity:get_user(user_id=5a3497accb3b42c4b025ade165e3bd1a)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.452848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.459126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 524/1054] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/users/5a3497accb3b42c4b025ade165e3bd1a => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:33.460042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.482970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.558372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c15675-c5ab-4021-93d9-37f17a2afc1f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.569901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de652135-de46-463e-a541-1f9dc4cce3dc None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.596459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.597607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.598055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.598323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.598948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] RBAC: Adding query filter params (type=image) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:33.599242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.600623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.601346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.606359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 531/1055] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:33.608994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.609682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.610056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.610376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.612549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.687895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.689395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.722027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.728941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3d37e-402c-4127-8335-25a33496aced None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.766085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.766697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.767317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.767317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.767892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.769812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.803240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 525/1056] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:00:33.809190 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:33.841436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:33.892397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 532/1057] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:00:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:00:33.925476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f835c-172e-4751-9ecf-4c17a58867b4 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:33.972693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096902a-1c03-4c69-9bf9-808afe253b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:33.973341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096902a-1c03-4c69-9bf9-808afe253b27 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:33.973616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096902a-1c03-4c69-9bf9-808afe253b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:33.973888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096902a-1c03-4c69-9bf9-808afe253b27 None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:33.975035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096902a-1c03-4c69-9bf9-808afe253b27 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:33.976540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096902a-1c03-4c69-9bf9-808afe253b27 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:33.983954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 526/1058] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:33.985377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:34.095673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9e05-73b0-483d-a747-3a31a3f68c50 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:34.132169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:34.132780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:34.133050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:34.133312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:34.134025 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28, user.id=5a3497accb3b42c4b025ade165e3bd1a) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:34.134326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:34.135846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4bd46-11d8-4762-b214-ab75fe37dd1d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:34.141658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 533/1059] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:33 2022] GET /identity/v3/role_assignments?user.id=5a3497accb3b42c4b025ade165e3bd1a&scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:34.583559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e17d-5765-4683-b351-4dc0b19f22b0 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:34.583956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e17d-5765-4683-b351-4dc0b19f22b0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:34.584180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624e17d-5765-4683-b351-4dc0b19f22b0 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:34.585651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 527/1060] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:34.591232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:34.591515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:34.591788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:34.610303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:34.611511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:34.623622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:34.688335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 534/1061] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:34.958014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624e17d-5765-4683-b351-4dc0b19f22b0 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:35.059685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:35.066578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624e17d-5765-4683-b351-4dc0b19f22b0 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:35.100353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:35.100977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:35.101251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:35.101519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:35.112061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:35.116797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:35.117754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:35.118633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 528/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 7 13:00:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:35.124001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:35.225080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8c74f-0b6b-445a-b12b-7e9fb1281650 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:35.259680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:35.260312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:35.260632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:35.260905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:35.261559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:35.261875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:35.263288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:35.276022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 535/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:00:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:35.278077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:35.379810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1a1f-f192-4d89-bbe0-dbcfcade4927 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:35.414291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:35.414921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:35.415198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:35.415469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:35.425475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:35.426921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:35.441761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:35.442736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:35.443660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:35.443660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:35.443660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:35.447563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 529/1064] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:35.448804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:35.461131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:35.599746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b6aaa-2a09-493c-a552-8e3710fb1f43 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:35.634768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:35.635398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:35.635652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:35.635921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:35.636601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:35.636905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:35.638264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:35.657407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 536/1065] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:35.658620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:35.674974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:35.768292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3691b-cbfb-4a50-9b65-8421ef5bd9b5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:35.802509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:35.803140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:35.803417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:35.803687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:35.811145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:35.812623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:35.823768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:35.825287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:35.832977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 530/1066] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 13:00:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:35.833718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:35.914003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:35.949262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c1ac1-b5e8-4595-ab76-51c6f2947ece None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:35.983063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:35.983698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:35.983972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:35.984270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:35.985020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:35.985324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:35.986785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4fb24-bd49-462e-b0a4-e8ea5974de2b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:36.013075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 537/1067] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 13:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:36.014958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.084254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.109128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1af160-f7b8-40d7-9540-2f2c709b9ee7 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.109411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1af160-f7b8-40d7-9540-2f2c709b9ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.109688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1af160-f7b8-40d7-9540-2f2c709b9ee7 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.111029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 538/1068] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:36.116061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a9ef-f0de-49c4-8c5b-3b9f7d7c4877 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.116368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a9ef-f0de-49c4-8c5b-3b9f7d7c4877 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.116643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986a9ef-f0de-49c4-8c5b-3b9f7d7c4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.118696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5fbb4-1cf8-45d5-91ad-4b3f66c57ab3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.138121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5986a9ef-f0de-49c4-8c5b-3b9f7d7c4877 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:36.139284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5986a9ef-f0de-49c4-8c5b-3b9f7d7c4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:36.162090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.162997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.163278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.163705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.176108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:36.177532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:36.196149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:36.197231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:36.198119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:36.198119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:36.198119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:36.198119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 531/1069] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:36.204210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.224494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 539/1070] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:36.309332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a555634-1d12-4122-abb9-0ca598df1dbc None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.309741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a555634-1d12-4122-abb9-0ca598df1dbc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.310131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a555634-1d12-4122-abb9-0ca598df1dbc None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.311640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 540/1071] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:00:36.314070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81155ad-3476-4cb9-a614-88dd2dd0f68c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.316347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.316630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.316902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.335588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:36.335789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.336816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:36.351213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.351832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.352121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.352397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.353028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:36.353328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:36.354684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:36.367133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 532/1072] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:36.372972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.396339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.414738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 541/1073] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:36.478205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba7423-9612-4322-92a7-4fdac6c3d690 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.497965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.515770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.516429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.516702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.516968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.523931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:36.525407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:36.536887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:36.537961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:36.538872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 533/1074] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:36.543946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.586356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.635658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4432768-f5f7-4955-9dc2-104e93fd03cd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.645698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eadc58-7521-46a8-b0c3-9ac9c4ffbd64 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.680866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.681484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.681755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.682019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.686108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.686717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.687070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.687346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.688157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:36.688466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:36.689906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:36.702855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 534/1075] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:36.704843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.738073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.751509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:36.752986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:36.800616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.803395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06805c-c5e0-4df2-ad33-58f98213ff88 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.836914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.837539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.837816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.838089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.848317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:36.850714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 542/1076] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 13:00:36.851524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:36.853093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:36.854004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:36.854840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 535/1077] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:36.857188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:36.941531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:36.956314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37028c4c-7de1-49ea-ba85-bab78902ad3f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.957232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d364c-72e1-4ba6-b8cb-c424c6fa0be9 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:36.991387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.991971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.992278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.992606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/08d7cfc07ef940b99652044bc7879601/roles/5054a9c9cc0940fda9ba8d4509a65873` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.993355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:36.993967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:36.994382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:36.994656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:36.994851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=08d7cfc07ef940b99652044bc7879601, role_id=5054a9c9cc0940fda9ba8d4509a65873)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:36.996924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.004991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.006429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:37.020941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:37.022838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:37.023782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:37.023782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:37.023782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:37.023782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 536/1078] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:37.023782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:37.037073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.088842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 543/1079] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:00:36 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/08d7cfc07ef940b99652044bc7879601/roles/5054a9c9cc0940fda9ba8d4509a65873 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:00:37.089793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:37.130634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40b26b-32a4-4321-9386-2bdbfd96fdd3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:37.168207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:37.169353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.169627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.169889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.170591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:37.170863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.172358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.182066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 537/1080] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:00:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:37.188241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:37.213367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769fad1-67b7-4e40-808b-d9756551603b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:37.254770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:37.255304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.257635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.257635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.257635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:37.257635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.258968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.273888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 544/1081] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:37.283349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.311607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e5c7d-6f5f-4a7c-bc39-753e526d699b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:37.350101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:37.350752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.351026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.351292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] PATH_INFO: `/v3/users/5a3497accb3b42c4b025ade165e3bd1a` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.352541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] RBAC: Authorizing `identity:get_user(user_id=5a3497accb3b42c4b025ade165e3bd1a)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.353997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.360147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 538/1082] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:37 2022] GET /identity/v3/users/5a3497accb3b42c4b025ade165e3bd1a => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:37.361947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:37.372606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:37.473300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504958d-dd9f-4122-a603-58ca4e9ae86f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:37.507837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe67c4-3daa-41a6-93bd-7e487cdd66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:37.508442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe67c4-3daa-41a6-93bd-7e487cdd66c1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.508719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe67c4-3daa-41a6-93bd-7e487cdd66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.508986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe67c4-3daa-41a6-93bd-7e487cdd66c1 None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.510099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe67c4-3daa-41a6-93bd-7e487cdd66c1 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.511543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe67c4-3daa-41a6-93bd-7e487cdd66c1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.516168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 545/1083] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:00:37 2022] GET /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:37.520419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:37.628108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18cb3b-44ca-4bcf-bb4f-42fce90bca3b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:37.663005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f7e3d-f9b4-48b4-8c47-01ee9b83a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:37.663665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f7e3d-f9b4-48b4-8c47-01ee9b83a879 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:37.663943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f7e3d-f9b4-48b4-8c47-01ee9b83a879 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:37.664249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f7e3d-f9b4-48b4-8c47-01ee9b83a879 None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28/users/5a3497accb3b42c4b025ade165e3bd1a/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:37.666173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f7e3d-f9b4-48b4-8c47-01ee9b83a879 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28, user_id=5a3497accb3b42c4b025ade165e3bd1a, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:37.667603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f7e3d-f9b4-48b4-8c47-01ee9b83a879 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:37.751429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 539/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:00:37 2022] PUT /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28/users/5a3497accb3b42c4b025ade165e3bd1a/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:00:39.271505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab0699-cac3-465e-8148-5fe1c9020726 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.272118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab0699-cac3-465e-8148-5fe1c9020726 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.272118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab0699-cac3-465e-8148-5fe1c9020726 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.273541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 546/1085] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:39.279123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.279554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.279651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.285868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:39.297800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:39.301968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:39.366118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 540/1086] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:39.633040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab0699-cac3-465e-8148-5fe1c9020726 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:39.710392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:39.736102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab0699-cac3-465e-8148-5fe1c9020726 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:39.770426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401a404-c258-4d90-8b37-2851e6682ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:39.771059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a404-c258-4d90-8b37-2851e6682ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.771330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a404-c258-4d90-8b37-2851e6682ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.771595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401a404-c258-4d90-8b37-2851e6682ea6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.785105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401a404-c258-4d90-8b37-2851e6682ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-5401a404-c258-4d90-8b37-2851e6682ea6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:39.790154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:39.791336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:39.792297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 547/1087] 10.222.0.57 () {56 vars in 1120 bytes} [Wed Sep 7 13:00:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:00:39.798208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:39.896565 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6a88d-cf15-461b-8f23-66ee3ab7419e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:39.899555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea94d-349b-4d4c-847e-4c732aeaa666 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.899833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea94d-349b-4d4c-847e-4c732aeaa666 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.900121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeea94d-349b-4d4c-847e-4c732aeaa666 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.901463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 548/1088] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:39.906715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.906999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.907272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.925423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:39.926613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:39.927409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:39.932593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:39.933196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:39.933468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:39.934036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:39.934532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:39.934828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:39.936208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:39.944267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 541/1089] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:00:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:39.950483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:39.993502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 549/1090] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:00:40.051420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e3f8d-89c1-425e-aece-4aba5663b969 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.083713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.084359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.084636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.084902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.095781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.097264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:40.111014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:40.112168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:40.113077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:40.113077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:40.113077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:40.113077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 542/1091] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:40.117827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.178383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.216170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c279a6-da9e-491c-8c11-5d82ada9a47d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.250008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.250611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.250885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.251154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.251791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:40.252115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.253482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.264744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 550/1092] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:40.265282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.270543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.312907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.365690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e36e-1ad4-4f09-9b9b-e3ac51f77b81 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.368967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7ce2a-0cfe-470b-be89-2db5338c18d3 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.392100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.400020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.405481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.405481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.405481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.405755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.405755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.405755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.405755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.411722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:00:40.412758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.414192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:00:40.416992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:40.418106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:00:40.419812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 543/1093] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:40.424620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:00:40.426550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:40.428060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:40.429353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 551/1094] 10.222.0.57 () {56 vars in 1093 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:40.433198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.526221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9772a6-b52b-45c7-8307-8dc10ef0b5db None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.532592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46521d7c-5cbf-4edb-9b1a-ed9bb576c1c7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.536536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.562683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.563278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.563551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.563816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.564564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:40.564862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.566223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.566754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.567358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.567636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.567911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.568666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:40.568969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.570372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.574417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 544/1095] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:40.580397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.587981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 552/1096] 10.222.0.57 () {56 vars in 1133 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:40.593410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.636745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.685688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ea04e-847b-47af-a946-afea26fae161 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.693081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822d55e-1428-4387-a8f5-2e600855e65c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.719265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.719888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.720197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.720468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] PATH_INFO: `/v3/users/5a3497accb3b42c4b025ade165e3bd1a` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.721594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=5a3497accb3b42c4b025ade165e3bd1a)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.723029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.724639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 545/1097] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/users/5a3497accb3b42c4b025ade165e3bd1a => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:40.727803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.728439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.728710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.728971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.730413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.764924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.797674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.799242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.829925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f7337-cd22-4138-a4c9-83ccd83ed9d8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:40.841213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:40.864782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:40.865439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:40.865714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:40.865982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:40.898889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 553/1098] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 13:00:40.904714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:40.933437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:40.935409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:40.968765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.003071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9c5a-1341-4524-8321-9375879ef264 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.033442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 546/1099] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 07 13:00:41.036666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.037296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.037568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.037835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.039408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.047955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.049421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.051102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:00:41.064425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:41.069187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:00:41.070241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:00:41.070241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:00:41.070241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:41.070241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 554/1100] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:41.071459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.144974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a20ef-b3b5-4f04-947d-b037ed7d88e5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.169304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72eb26e-1c05-4228-9767-2c3556823e10 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.177985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.178601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.178872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.179137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.180253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.181683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.183297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 547/1101] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:41.189737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.193038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.206563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.207168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.207439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.207700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.208361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:41.208658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.210017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.221724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 555/1102] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:41.227017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.281912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.288919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992e3f-ae21-4eae-ba20-b3ea516dd131 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.323739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.324394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.324571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.324836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.325537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28, user.id=5a3497accb3b42c4b025ade165e3bd1a) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:41.325834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.327280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.327385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7512ca0-d9b5-4712-8fe1-000f12c36c22 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.333053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 548/1103] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/role_assignments?user.id=5a3497accb3b42c4b025ade165e3bd1a&scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:00:41.362498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.363155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.363426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.363694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.372002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.373499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:00:41.385627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:00:41.386672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:00:41.387960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 556/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:00:41.392962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.463585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.498685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7ee3b-7901-4588-88a1-3c2c22cbc72d None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.533869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.534475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.534751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.535023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.535711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:41.536017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.537479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249aba88-8ae0-4097-bc1b-919b76fddabe None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.550221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 549/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:41.556594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:41.657093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519820dd-10e9-4e1c-9d34-68c493d85c81 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:41.671264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:41.690427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:41.691033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:41.691303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:41.691567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:41.692312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] RBAC: Adding query filter params (role.id=5054a9c9cc0940fda9ba8d4509a65873, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=08d7cfc07ef940b99652044bc7879601) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:41.692612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:41.694012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073960c-6156-4c23-8977-df31189ccb15 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:41.699891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 557/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:41 2022] GET /identity/v3/role_assignments?user.id=08d7cfc07ef940b99652044bc7879601&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=5054a9c9cc0940fda9ba8d4509a65873 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:43.517628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbe6a-c999-4499-b5a5-5f3d31259f8f None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:43.518184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbe6a-c999-4499-b5a5-5f3d31259f8f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:43.518184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbe6a-c999-4499-b5a5-5f3d31259f8f None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:43.519755 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 550/1107] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:43.525157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:43.525580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:43.525681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:43.543917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:43.545127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:43.615976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 558/1108] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:43.890157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbe6a-c999-4499-b5a5-5f3d31259f8f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:43.989346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbe6a-c999-4499-b5a5-5f3d31259f8f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:44.014444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:44.022159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01587-8536-4e10-923b-6e440c0e0a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:44.022775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01587-8536-4e10-923b-6e440c0e0a1d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:44.023046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01587-8536-4e10-923b-6e440c0e0a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:44.023312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01587-8536-4e10-923b-6e440c0e0a1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:44.024432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01587-8536-4e10-923b-6e440c0e0a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:44.025857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01587-8536-4e10-923b-6e440c0e0a1d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:44.027949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 551/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:44.033657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:44.130828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756acfa-ae68-42a0-94b5-4627d51dc2a8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:44.139732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:44.163959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96630146-1360-4be7-bd4a-415524b48959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:44.164526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630146-1360-4be7-bd4a-415524b48959 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:44.164802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630146-1360-4be7-bd4a-415524b48959 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:44.165068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96630146-1360-4be7-bd4a-415524b48959 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:44.165703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630146-1360-4be7-bd4a-415524b48959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:44.167115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96630146-1360-4be7-bd4a-415524b48959 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:44.277070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 559/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 13:00:44 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:46.453734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b926a-242e-43cd-9716-64c8218fc85d None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.454304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b926a-242e-43cd-9716-64c8218fc85d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.454304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b926a-242e-43cd-9716-64c8218fc85d None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.455634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 552/1111] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:46.460747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.461147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.461279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.478932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:46.480111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:46.545112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 560/1112] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:46.813098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b926a-242e-43cd-9716-64c8218fc85d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:46.914608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b926a-242e-43cd-9716-64c8218fc85d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:46.947383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:46.947996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:46.948300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:46.948575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] PATH_INFO: `/v3/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:46.950568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] RBAC: Authorizing `identity:get_role(role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:46.951934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:46.953296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 553/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:46 2022] GET /identity/v3/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:46.959096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:47.048613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:47.055406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac485-8be7-43e0-8193-c8be79436855 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:47.088486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:47.089051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:47.089327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:47.089600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] PATH_INFO: `/v3/users/aa7225df53af4ff68f393e0f41be40a0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:47.103424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7225df53af4ff68f393e0f41be40a0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:47.104890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:47.107318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 561/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:46 2022] GET /identity/v3/users/aa7225df53af4ff68f393e0f41be40a0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:47.112972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:47.173590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:47.209753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0435006-861a-4285-9959-2f81f172c828 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:47.243945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:47.244584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:47.244862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:47.245130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:47.310191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:47.311637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:47.370379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:47.408278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 554/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:00:47.414255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:47.511232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830167c3-cea9-424e-903b-56ce07b71527 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:47.544452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66e97e-a0d6-4a9e-a1bc-3b74e4fe6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:47.545065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e97e-a0d6-4a9e-a1bc-3b74e4fe6c9b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:47.545342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e97e-a0d6-4a9e-a1bc-3b74e4fe6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:47.545609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e97e-a0d6-4a9e-a1bc-3b74e4fe6c9b None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:47.546735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e97e-a0d6-4a9e-a1bc-3b74e4fe6c9b None admin] RBAC: Authorizing `identity:get_project(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:47.548162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66e97e-a0d6-4a9e-a1bc-3b74e4fe6c9b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:47.549756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 562/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:00:47 2022] GET /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:47.555867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:47.660186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145a770-4713-4701-81b8-2af8a9393b49 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:47.693485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:47.694085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:47.694362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:47.694631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:47.695343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] RBAC: Adding query filter params (role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28, user.id=aa7225df53af4ff68f393e0f41be40a0) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:47.695648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:47.697105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71471f-a670-46e6-8da3-91b858304c0b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:47.702476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 555/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:47 2022] GET /identity/v3/role_assignments?user.id=aa7225df53af4ff68f393e0f41be40a0&scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:49.821130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9532a-06dd-412a-90d5-041a1f9d1555 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:49.821660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9532a-06dd-412a-90d5-041a1f9d1555 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:49.821660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9532a-06dd-412a-90d5-041a1f9d1555 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:49.822997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 563/1118] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:49.828285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:49.828710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:49.828819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:49.848002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:49.849323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:49.878685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:49.924678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 556/1119] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:50.202369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9532a-06dd-412a-90d5-041a1f9d1555 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:50.226251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:50.311644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9532a-06dd-412a-90d5-041a1f9d1555 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:50.346012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:50.346643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:50.346919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:50.347192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] PATH_INFO: `/v3/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:50.348601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] RBAC: Authorizing `identity:get_role(role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:50.349974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:50.351301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 564/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:50 2022] GET /identity/v3/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:50.357554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:50.458438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c5c93-ac83-4454-af6b-9010528a3990 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:50.491903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:50.492555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:50.492833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:50.493100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] PATH_INFO: `/v3/users/aa7225df53af4ff68f393e0f41be40a0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:50.494208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=aa7225df53af4ff68f393e0f41be40a0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:50.495638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:50.497880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 557/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:50 2022] GET /identity/v3/users/aa7225df53af4ff68f393e0f41be40a0 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:50.503692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:50.597129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:50.609132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8d6de-f931-465f-ba98-f436e2b737ab None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:50.645479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cba2e-0adc-4e9f-b1fc-fded549400f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:50.646116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cba2e-0adc-4e9f-b1fc-fded549400f6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:50.646392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cba2e-0adc-4e9f-b1fc-fded549400f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:50.646663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cba2e-0adc-4e9f-b1fc-fded549400f6 None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:50.647799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cba2e-0adc-4e9f-b1fc-fded549400f6 None admin] RBAC: Authorizing `identity:get_project(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:50.649271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cba2e-0adc-4e9f-b1fc-fded549400f6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:50.650923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 565/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:00:50 2022] GET /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:50.657883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:50.685957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:50.756230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b97a6-9292-4139-8293-e8ebb47b8ab7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:50.789743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff6a81-62a3-4603-b47d-ff80539b1750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:50.790392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff6a81-62a3-4603-b47d-ff80539b1750 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:50.790667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff6a81-62a3-4603-b47d-ff80539b1750 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:50.790937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff6a81-62a3-4603-b47d-ff80539b1750 None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28/users/aa7225df53af4ff68f393e0f41be40a0/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:50.793650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff6a81-62a3-4603-b47d-ff80539b1750 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28, user_id=aa7225df53af4ff68f393e0f41be40a0, role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:50.795084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff6a81-62a3-4603-b47d-ff80539b1750 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:50.867722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 558/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:00:50 2022] PUT /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28/users/aa7225df53af4ff68f393e0f41be40a0/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:00:52.998508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c57c-eb98-4516-8340-7e54747517e4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:52.999037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c57c-eb98-4516-8340-7e54747517e4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:52.999037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c57c-eb98-4516-8340-7e54747517e4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:53.000319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 566/1124] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:53.005566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:53.005984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:53.006106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:53.024866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:53.026042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:53.090607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 559/1125] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:53.358514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c57c-eb98-4516-8340-7e54747517e4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:53.457882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c57c-eb98-4516-8340-7e54747517e4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:53.490688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:53.491305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:53.491579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:53.491847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] PATH_INFO: `/v3/roles/5b3e0d09a6e1407783b4de579ed08154` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:53.493241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] RBAC: Authorizing `identity:get_role(role_id=5b3e0d09a6e1407783b4de579ed08154)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:53.494597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:53.495903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 567/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:53 2022] GET /identity/v3/roles/5b3e0d09a6e1407783b4de579ed08154 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:53.502150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:53.519060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:53.598183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a1267-6191-4e0b-b8e2-e540321ac1cf None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:53.631834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:53.632487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:53.632757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:53.633019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] PATH_INFO: `/v3/users/aa7225df53af4ff68f393e0f41be40a0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:53.634118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] RBAC: Authorizing `identity:get_user(user_id=aa7225df53af4ff68f393e0f41be40a0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:53.636204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:53.638641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 560/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:00:53 2022] GET /identity/v3/users/aa7225df53af4ff68f393e0f41be40a0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:53.644492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:53.673139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:53.744294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a6e61-51ca-4f48-a738-06f35f4b10a2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:53.776913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:53.778037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:53.778304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:53.778561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:53.841850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:53.843276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:53.866971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:53.937364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 568/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:00:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:00:53.943231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:54.023156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:54.037829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4360a8e-5ec5-4913-9e86-a1313e1802af None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:54.070225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718acbc-8496-4bb4-967d-866b21aca00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:54.070832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718acbc-8496-4bb4-967d-866b21aca00c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:54.071107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718acbc-8496-4bb4-967d-866b21aca00c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:54.071372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718acbc-8496-4bb4-967d-866b21aca00c None admin] PATH_INFO: `/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:54.072472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718acbc-8496-4bb4-967d-866b21aca00c None admin] RBAC: Authorizing `identity:get_project(project_id=9e29d8c12f1d4ce88b3bf6c6a9355a28)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:54.073879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718acbc-8496-4bb4-967d-866b21aca00c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:54.076011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 561/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:00:53 2022] GET /identity/v3/projects/9e29d8c12f1d4ce88b3bf6c6a9355a28 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:54.082169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:54.179249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74695489-edbd-41ac-9177-437ed74ab0b8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:54.201694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:54.211744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:54.213375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:54.213375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:54.213375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:54.213679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] RBAC: Adding query filter params (role.id=5b3e0d09a6e1407783b4de579ed08154, scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28, user.id=aa7225df53af4ff68f393e0f41be40a0) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:00:54.213984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:54.216003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f37b10d-46e5-40ab-8c9f-8810c6351d37 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:54.221631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 569/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:00:54 2022] GET /identity/v3/role_assignments?user.id=aa7225df53af4ff68f393e0f41be40a0&scope.project.id=9e29d8c12f1d4ce88b3bf6c6a9355a28&role.id=5b3e0d09a6e1407783b4de579ed08154 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:56.403300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da41a0-ac02-4427-a404-220d3c293ec7 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:56.403902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da41a0-ac02-4427-a404-220d3c293ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:56.403902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da41a0-ac02-4427-a404-220d3c293ec7 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:56.405217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 562/1131] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:56.410515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:56.410964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:56.411058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:56.429027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:56.430209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:56.494700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 570/1132] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:56.771222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da41a0-ac02-4427-a404-220d3c293ec7 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:56.868703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da41a0-ac02-4427-a404-220d3c293ec7 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:56.901890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f27c4c-093e-46ca-bceb-01950e264fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:56.902519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27c4c-093e-46ca-bceb-01950e264fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:56.902791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27c4c-093e-46ca-bceb-01950e264fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:56.903057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f27c4c-093e-46ca-bceb-01950e264fd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:56.904160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f27c4c-093e-46ca-bceb-01950e264fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:56.905567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f27c4c-093e-46ca-bceb-01950e264fd3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:56.907092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 563/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:56.912961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:57.009012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1159d33-3c94-44e1-af0d-5eccc0ca6f10 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:57.025647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:57.041889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8eff62-b3e1-4ac9-aff4-988156dbce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:57.042486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eff62-b3e1-4ac9-aff4-988156dbce46 None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:57.042763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eff62-b3e1-4ac9-aff4-988156dbce46 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:57.043617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8eff62-b3e1-4ac9-aff4-988156dbce46 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:57.044340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eff62-b3e1-4ac9-aff4-988156dbce46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:57.045782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8eff62-b3e1-4ac9-aff4-988156dbce46 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:57.131491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 571/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:00:56 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:00:59.285903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f5bd-6976-41c5-ba3c-c9d04745faa0 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:59.286457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f5bd-6976-41c5-ba3c-c9d04745faa0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:59.286457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5f5bd-6976-41c5-ba3c-c9d04745faa0 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:59.287763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 564/1135] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:00:59.293603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:59.293978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:59.294143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:59.312330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:00:59.313506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:00:59.378026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 572/1136] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:00:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:00:59.644647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f5bd-6976-41c5-ba3c-c9d04745faa0 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:59.667126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:59.745366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5f5bd-6976-41c5-ba3c-c9d04745faa0 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:59.778358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faecc1c-6107-4879-9a5a-ea38054b9bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:59.778961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faecc1c-6107-4879-9a5a-ea38054b9bcc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:59.779231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faecc1c-6107-4879-9a5a-ea38054b9bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:59.779496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faecc1c-6107-4879-9a5a-ea38054b9bcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:59.780733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faecc1c-6107-4879-9a5a-ea38054b9bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:59.782151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faecc1c-6107-4879-9a5a-ea38054b9bcc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:59.783704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 565/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:00:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:00:59.789384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:00:59.883456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:00:59.886303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca117141-6da8-4396-86ba-a3f3632e1d07 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:00:59.919306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ecdd5-c4ae-49f4-a6ab-4ffe8f36874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:00:59.919844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ecdd5-c4ae-49f4-a6ab-4ffe8f36874d None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:00:59.920144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ecdd5-c4ae-49f4-a6ab-4ffe8f36874d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:00:59.920420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ecdd5-c4ae-49f4-a6ab-4ffe8f36874d None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:00:59.921075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ecdd5-c4ae-49f4-a6ab-4ffe8f36874d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:00:59.922495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ecdd5-c4ae-49f4-a6ab-4ffe8f36874d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:00:59.992892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 573/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 13:00:59 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:01:02.156777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8eddd-f071-4194-9ef0-a763d15e425a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.157323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8eddd-f071-4194-9ef0-a763d15e425a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.157323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8eddd-f071-4194-9ef0-a763d15e425a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.158659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 566/1139] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:02.163837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.164401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.164401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.182723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:02.183956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:02.257532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 574/1140] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 07 13:01:02.530142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8eddd-f071-4194-9ef0-a763d15e425a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:02.617142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:02.629535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8eddd-f071-4194-9ef0-a763d15e425a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:02.662349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:02.662965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.663240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.663506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.674165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:01:02.679282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:02.680413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:01:02.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 567/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:01:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:02.686466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:02.769046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:02.786822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc77ae7-3a36-4dd7-9bda-9d6e04d48ff3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:02.817054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:02.817641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.817912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.818176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.818822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:02.819118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:02.820492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:02.828309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 575/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:01:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:02.834265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:02.931871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f6de1-8f4b-4fe2-80ec-d8b818a657b8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:02.965185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:02.965795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:02.966097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:02.966371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] PATH_INFO: `/v3/users/92653f335e8b46f49da2d7d504af2e72` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:02.979666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] RBAC: Authorizing `identity:get_user(user_id=92653f335e8b46f49da2d7d504af2e72)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:02.981639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:02.983218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 568/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:01:02 2022] GET /identity/v3/users/92653f335e8b46f49da2d7d504af2e72 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:02.990720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:03.086873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e9e6d-2385-4a1f-965d-43a429dd9d4c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:03.119758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:03.120369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:03.120642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:03.120908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:03.140349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:03.189617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:03.191037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:03.284092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 576/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:01:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:01:03.290127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:03.298892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:03.386534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435889b-0bb6-4991-afe4-82384ed332bd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:03.419680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58b5e-3823-46ea-b8e9-daa724650dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:03.420312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58b5e-3823-46ea-b8e9-daa724650dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:03.420588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58b5e-3823-46ea-b8e9-daa724650dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:03.420854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58b5e-3823-46ea-b8e9-daa724650dc1 None admin] PATH_INFO: `/v3/projects/df868f9dcf434895b347f7ba9fc2ad60` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:03.421940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58b5e-3823-46ea-b8e9-daa724650dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=df868f9dcf434895b347f7ba9fc2ad60)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:03.423379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58b5e-3823-46ea-b8e9-daa724650dc1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:03.425019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 569/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:01:03 2022] GET /identity/v3/projects/df868f9dcf434895b347f7ba9fc2ad60 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:03.431117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:03.481689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:03.537139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c36f3-c787-4a13-9205-bdbd7f9a1120 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:03.569493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:03.570098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:03.570367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:03.570629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:03.571331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=df868f9dcf434895b347f7ba9fc2ad60, user.id=92653f335e8b46f49da2d7d504af2e72) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:03.571627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:03.573140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd99a7-0e4f-4546-ab74-e3bdaab46dc6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:03.578379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 577/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:01:03 2022] GET /identity/v3/role_assignments?user.id=92653f335e8b46f49da2d7d504af2e72&scope.project.id=df868f9dcf434895b347f7ba9fc2ad60&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:05.678084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698dbe-77b6-46a7-adb5-3ac30d22bd64 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:05.678529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698dbe-77b6-46a7-adb5-3ac30d22bd64 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:05.678639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698dbe-77b6-46a7-adb5-3ac30d22bd64 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:05.679973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 570/1147] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:05.685038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:05.685447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:05.685608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:05.703329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:05.704546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:05.771495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 578/1148] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:06.047133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698dbe-77b6-46a7-adb5-3ac30d22bd64 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:06.119742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:06.145576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698dbe-77b6-46a7-adb5-3ac30d22bd64 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:06.178501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:06.179116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:06.179393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:06.179663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:06.190589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:01:06.195362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:06.196472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:01:06.197665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 571/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:06.202678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:06.250305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:06.304419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39286ee1-71d0-4379-a8f9-2785ab7a73aa None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:06.337327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:06.337936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:06.338209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:06.338476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:06.339123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:06.339420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:06.341334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:06.349584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 579/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:06.356057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:06.452342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b83ea8-80db-4c85-b45a-b6e4d10f98e5 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:06.485373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:06.485977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:06.486254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:06.486526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] PATH_INFO: `/v3/users/92653f335e8b46f49da2d7d504af2e72` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:06.487627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] RBAC: Authorizing `identity:get_user(user_id=92653f335e8b46f49da2d7d504af2e72)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:06.489078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:06.490620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 572/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:01:06 2022] GET /identity/v3/users/92653f335e8b46f49da2d7d504af2e72 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:06.496484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:06.593628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a2246-0bf1-4858-9510-d89418f4495d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:06.595791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:06.626067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbed5d-4f26-40f0-a7ce-27a33329b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:06.626726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbed5d-4f26-40f0-a7ce-27a33329b3ee None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:06.627263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbed5d-4f26-40f0-a7ce-27a33329b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:06.627744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbed5d-4f26-40f0-a7ce-27a33329b3ee None admin] PATH_INFO: `/v3/projects/df868f9dcf434895b347f7ba9fc2ad60` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:06.629211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbed5d-4f26-40f0-a7ce-27a33329b3ee None admin] RBAC: Authorizing `identity:get_project(project_id=df868f9dcf434895b347f7ba9fc2ad60)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:06.630703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbed5d-4f26-40f0-a7ce-27a33329b3ee None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:06.632376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 580/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:01:06 2022] GET /identity/v3/projects/df868f9dcf434895b347f7ba9fc2ad60 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:06.638233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:06.641023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:06.737993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d54f82-5cfc-429b-8be0-41ac0c8ef64a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:06.771223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fc784-3a4a-4e7a-ad31-9abfe7f2c322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:06.771883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc784-3a4a-4e7a-ad31-9abfe7f2c322 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:06.772184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc784-3a4a-4e7a-ad31-9abfe7f2c322 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:06.772455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fc784-3a4a-4e7a-ad31-9abfe7f2c322 None admin] PATH_INFO: `/v3/projects/df868f9dcf434895b347f7ba9fc2ad60/users/92653f335e8b46f49da2d7d504af2e72/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:06.774343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fc784-3a4a-4e7a-ad31-9abfe7f2c322 None admin] RBAC: Authorizing `identity:create_grant(project_id=df868f9dcf434895b347f7ba9fc2ad60, user_id=92653f335e8b46f49da2d7d504af2e72, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:06.775773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fc784-3a4a-4e7a-ad31-9abfe7f2c322 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:06.890734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 573/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:01:06 2022] PUT /identity/v3/projects/df868f9dcf434895b347f7ba9fc2ad60/users/92653f335e8b46f49da2d7d504af2e72/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:01:09.018272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df3aac-5b8d-4e60-8ea9-f5197bb409d1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:09.018776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df3aac-5b8d-4e60-8ea9-f5197bb409d1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:09.018776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df3aac-5b8d-4e60-8ea9-f5197bb409d1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:09.020375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 581/1154] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:09.025664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:09.026086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:09.026205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:09.045386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:09.046581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:09.101756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:09.111855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 574/1155] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:09.389946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df3aac-5b8d-4e60-8ea9-f5197bb409d1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:09.486494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df3aac-5b8d-4e60-8ea9-f5197bb409d1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:09.522020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:09.522632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:09.522903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:09.523166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:09.533280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:01:09.537979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:09.539268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:01:09.540497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 582/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:01:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:09.545228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:09.642039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892b09c-db84-4b6b-a076-102dfa86912e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:09.676065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:09.676687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:09.676961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:09.677229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:09.677879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:09.678173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:09.679532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:09.687948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 575/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:01:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:09.693995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:09.724585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:09.791615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8dcfe-dffe-4d44-949d-a40e855bad42 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:09.826191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:09.826802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:09.827073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:09.827341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] PATH_INFO: `/v3/users/92653f335e8b46f49da2d7d504af2e72` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:09.828471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] RBAC: Authorizing `identity:get_user(user_id=92653f335e8b46f49da2d7d504af2e72)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:09.829880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:09.831430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 583/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:01:09 2022] GET /identity/v3/users/92653f335e8b46f49da2d7d504af2e72 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:09.837212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:09.891073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:09.934588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978f0ec-6ba3-46c8-8097-b6b3391a2c93 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:09.966614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:09.967206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:09.967480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:09.967746 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:10.036224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:10.037666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:10.089572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:10.133965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 576/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:01:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:01:10.140030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:10.233806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:10.236593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c07997-0d37-446e-8578-086e3cc29313 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:10.269143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23879a-c745-4386-a7f8-e5d3b0fc72be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:10.269773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23879a-c745-4386-a7f8-e5d3b0fc72be None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:10.270302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23879a-c745-4386-a7f8-e5d3b0fc72be None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:10.270569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23879a-c745-4386-a7f8-e5d3b0fc72be None admin] PATH_INFO: `/v3/projects/df868f9dcf434895b347f7ba9fc2ad60` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:10.271671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23879a-c745-4386-a7f8-e5d3b0fc72be None admin] RBAC: Authorizing `identity:get_project(project_id=df868f9dcf434895b347f7ba9fc2ad60)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:10.273118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23879a-c745-4386-a7f8-e5d3b0fc72be None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:10.274722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 584/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:01:10 2022] GET /identity/v3/projects/df868f9dcf434895b347f7ba9fc2ad60 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:10.281487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:10.382605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f31cc-f897-4149-8ad8-971db74a41c8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:10.416874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:10.417468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:10.417743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:10.418009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:10.418723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=df868f9dcf434895b347f7ba9fc2ad60, user.id=92653f335e8b46f49da2d7d504af2e72) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:10.419032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:10.421105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b19dc-c9bf-4daa-8323-91e6abe64720 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:10.426834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 577/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:01:10 2022] GET /identity/v3/role_assignments?user.id=92653f335e8b46f49da2d7d504af2e72&scope.project.id=df868f9dcf434895b347f7ba9fc2ad60&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:12.578726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de592370-ce36-4de2-8295-516fdc3177d6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:12.579258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de592370-ce36-4de2-8295-516fdc3177d6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:12.579258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de592370-ce36-4de2-8295-516fdc3177d6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:12.580636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 585/1162] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:12.585854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:12.586292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:12.586394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:12.604516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:12.605666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:12.619040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:12.672529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 578/1163] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:12.942842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de592370-ce36-4de2-8295-516fdc3177d6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:13.041289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de592370-ce36-4de2-8295-516fdc3177d6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:13.074906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:13.075502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:13.075779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:13.076049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:13.109716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:13.141540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:13.143268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:13.237304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 586/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:01:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:01:13.243177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:13.341736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7a254-65f4-4fd4-a288-5cf51a3f741b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:13.374754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:13.375377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:13.375655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:13.375923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:13.382390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:13.383843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f1991119-6176-413d-968f-da3d677c6e3b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:13.395749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:13.396974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:01:13.398042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 579/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:01:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:13.403015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:13.466952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:13.499432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee8638-21ba-4c6a-bcf6-0beeb746159e None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:13.532422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:13.533024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:13.533301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:13.533568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:13.534240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:13.534550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:13.536057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f62f00-2f18-4213-800f-b6da5af9da47 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:13.544233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 587/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Wed Sep 7 13:01:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:15.670973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce6bf-1aeb-48d2-85f6-2647ca6a5ab5 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:15.671384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce6bf-1aeb-48d2-85f6-2647ca6a5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:15.671519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ce6bf-1aeb-48d2-85f6-2647ca6a5ab5 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:15.672933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 580/1167] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:15.678121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e652a0-6c71-44f3-9c6b-cf704f3750cc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:15.678500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e652a0-6c71-44f3-9c6b-cf704f3750cc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:15.678671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e652a0-6c71-44f3-9c6b-cf704f3750cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:15.697736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-13e652a0-6c71-44f3-9c6b-cf704f3750cc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:15.698906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-13e652a0-6c71-44f3-9c6b-cf704f3750cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:15.764044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 588/1168] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:16.031003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce6bf-1aeb-48d2-85f6-2647ca6a5ab5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:16.042118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:16.131294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ce6bf-1aeb-48d2-85f6-2647ca6a5ab5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:16.163916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3dc24-db86-480f-8df1-69ac869e8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:16.164535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3dc24-db86-480f-8df1-69ac869e8da5 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:16.164818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3dc24-db86-480f-8df1-69ac869e8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:16.165086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3dc24-db86-480f-8df1-69ac869e8da5 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:16.165739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3dc24-db86-480f-8df1-69ac869e8da5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:16.167109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3dc24-db86-480f-8df1-69ac869e8da5 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:16.246365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 581/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Wed Sep 7 13:01:16 2022] POST /identity/v3/domains => generated 267 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:01:18.443078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4eb53-94c6-468b-a3e4-031049461127 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:18.443631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4eb53-94c6-468b-a3e4-031049461127 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:18.443631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4eb53-94c6-468b-a3e4-031049461127 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:18.444994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 589/1170] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:18.450314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:18.450690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:18.450850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:18.469635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:18.470816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:18.530042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:18.535955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 582/1171] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:18.801990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4eb53-94c6-468b-a3e4-031049461127 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:18.862950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:18.902694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4eb53-94c6-468b-a3e4-031049461127 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:18.934483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f93cb3-6b42-4622-9374-ad2db277d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:18.935098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93cb3-6b42-4622-9374-ad2db277d12c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:18.935375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93cb3-6b42-4622-9374-ad2db277d12c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:18.935646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f93cb3-6b42-4622-9374-ad2db277d12c None admin] PATH_INFO: `/v3/domains/2fcd260f27fc493d8ada24eb80de138b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:18.946589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f93cb3-6b42-4622-9374-ad2db277d12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=2fcd260f27fc493d8ada24eb80de138b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:18.948031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f93cb3-6b42-4622-9374-ad2db277d12c None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:18.949634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 590/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Wed Sep 7 13:01:18 2022] GET /identity/v3/domains/2fcd260f27fc493d8ada24eb80de138b => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:18.956166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:19.051862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b0b94-c59d-40b0-9f2a-5bbadf53dae9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:19.084098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b19fd-b4e5-4e85-8336-90486bc7983a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:19.084637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b19fd-b4e5-4e85-8336-90486bc7983a None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:19.084907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b19fd-b4e5-4e85-8336-90486bc7983a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:19.085171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b19fd-b4e5-4e85-8336-90486bc7983a None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:19.085807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b19fd-b4e5-4e85-8336-90486bc7983a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:19.087215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b19fd-b4e5-4e85-8336-90486bc7983a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:19.198225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 583/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:01:18 2022] POST /identity/v3/projects => generated 361 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:01:21.357932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0a98-e0cb-465f-a21f-7af8b0b4e254 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:21.358617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0a98-e0cb-465f-a21f-7af8b0b4e254 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:21.358617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c0a98-e0cb-465f-a21f-7af8b0b4e254 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:21.359862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 591/1174] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:21.365361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:21.365780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:21.365904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:21.391030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:21.392227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:21.437771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:21.457817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 584/1175] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:21.725460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0a98-e0cb-465f-a21f-7af8b0b4e254 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:21.822567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c0a98-e0cb-465f-a21f-7af8b0b4e254 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:21.844312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:21.855358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd3260-6b21-4b5c-bc4c-d7a1f78232ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:21.855969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3260-6b21-4b5c-bc4c-d7a1f78232ea None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:21.856274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3260-6b21-4b5c-bc4c-d7a1f78232ea None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:21.856540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd3260-6b21-4b5c-bc4c-d7a1f78232ea None admin] PATH_INFO: `/v3/domains/2fcd260f27fc493d8ada24eb80de138b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:21.857628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd3260-6b21-4b5c-bc4c-d7a1f78232ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=2fcd260f27fc493d8ada24eb80de138b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:21.859075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd3260-6b21-4b5c-bc4c-d7a1f78232ea None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:21.860634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 592/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Wed Sep 7 13:01:21 2022] GET /identity/v3/domains/2fcd260f27fc493d8ada24eb80de138b => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:21.866351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:21.963286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cc751-98b7-4501-a110-2e9448eb270c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:21.995292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62b6ba-37a4-434d-b540-1c2a72adf43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:21.995882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62b6ba-37a4-434d-b540-1c2a72adf43a None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:21.996182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62b6ba-37a4-434d-b540-1c2a72adf43a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:21.996451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62b6ba-37a4-434d-b540-1c2a72adf43a None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:21.997087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62b6ba-37a4-434d-b540-1c2a72adf43a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:21.998496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62b6ba-37a4-434d-b540-1c2a72adf43a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:22.128900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 585/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 13:01:21 2022] POST /identity/v3/users => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:01:24.309397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9fb8c-8d78-4e3e-b387-f3604f47c1b2 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:24.309950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9fb8c-8d78-4e3e-b387-f3604f47c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:24.309950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9fb8c-8d78-4e3e-b387-f3604f47c1b2 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:24.311278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 593/1178] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:24.316401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:24.316806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:24.316944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:24.335058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:24.336258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:24.364050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:24.400738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 586/1179] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:24.674689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9fb8c-8d78-4e3e-b387-f3604f47c1b2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:24.772869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9fb8c-8d78-4e3e-b387-f3604f47c1b2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:24.804381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:24.804988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:24.805258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:24.805522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:24.815790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:01:24.820448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:24.821524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:01:24.822502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 594/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:24.828390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:24.923086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9671bdc-fcf5-4d08-bcad-2be277743baa None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:24.957073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:24.957668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:24.957939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:24.958204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:24.958849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:24.959203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:24.960673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:24.968348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 587/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:24.974183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:25.023528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.074757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db89ef-ec7b-4fe3-9604-c0ad82f0c7d7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:25.109178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:25.109802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:25.110076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:25.110346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] PATH_INFO: `/v3/users/bc386277cebf4736bd95694880c1dd10` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:25.123649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] RBAC: Authorizing `identity:get_user(user_id=bc386277cebf4736bd95694880c1dd10)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:25.125837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:25.127470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 595/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:01:24 2022] GET /identity/v3/users/bc386277cebf4736bd95694880c1dd10 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:25.133188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:25.160792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.229033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712d9be-0b2a-4093-9380-6406c11a569a None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:25.261918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:25.262507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:25.262779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:25.263044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:25.326837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:25.328320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:25.353245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.422238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 588/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:01:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:01:25.428310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:25.527200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177a8f8-8612-452b-842f-322c17c0bd38 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:25.536744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.561075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba1db0-4e32-46eb-be8e-6417fe55b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:25.561716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba1db0-4e32-46eb-be8e-6417fe55b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:25.561989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba1db0-4e32-46eb-be8e-6417fe55b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:25.562259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba1db0-4e32-46eb-be8e-6417fe55b3c6 None admin] PATH_INFO: `/v3/projects/450e1338f4c64117b7f14ea91ac86816` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:25.563353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba1db0-4e32-46eb-be8e-6417fe55b3c6 None admin] RBAC: Authorizing `identity:get_project(project_id=450e1338f4c64117b7f14ea91ac86816)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:25.564815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba1db0-4e32-46eb-be8e-6417fe55b3c6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:25.566774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 596/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:01:25 2022] GET /identity/v3/projects/450e1338f4c64117b7f14ea91ac86816 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:01:25.572898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:25.670375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4727aa-859a-4912-b889-dd2091889d91 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:25.696229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:25.703723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:25.706118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:25.706118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:25.706118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:25.706118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=450e1338f4c64117b7f14ea91ac86816, user.id=bc386277cebf4736bd95694880c1dd10) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:25.706118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:25.707250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2437e-206d-4d85-9118-d5098d4dfeba None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:25.712512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 589/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:01:25 2022] GET /identity/v3/role_assignments?user.id=bc386277cebf4736bd95694880c1dd10&scope.project.id=450e1338f4c64117b7f14ea91ac86816&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:27.832721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8016ab-cd20-48d1-9409-16a234c4e33e None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:27.833276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8016ab-cd20-48d1-9409-16a234c4e33e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:27.833276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8016ab-cd20-48d1-9409-16a234c4e33e None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:27.834602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 597/1186] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:27.839621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:27.840031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:27.840192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:27.858013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:27.859185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:27.924969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 590/1187] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:28.195199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8016ab-cd20-48d1-9409-16a234c4e33e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:28.296276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8016ab-cd20-48d1-9409-16a234c4e33e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:28.329187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:28.329803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.330078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.330351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.340131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:01:28.345458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:28.346515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:01:28.347370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 598/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:28.352676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:28.449621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd7906-1580-4290-bbea-224037a00554 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:28.471697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:28.482845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:28.483598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.483793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.484120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.484783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:28.485086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:28.486457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:28.494360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 591/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:28.500636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:28.535940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:28.598754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165cf8-da03-40c2-a6bd-1fecacaaf6c0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:28.631573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:28.632224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.632501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.632772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] PATH_INFO: `/v3/users/bc386277cebf4736bd95694880c1dd10` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.633874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] RBAC: Authorizing `identity:get_user(user_id=bc386277cebf4736bd95694880c1dd10)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:28.635295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:28.636883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 599/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:01:28 2022] GET /identity/v3/users/bc386277cebf4736bd95694880c1dd10 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:28.643352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:28.741343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edb020-eb59-4924-ad8e-744f56e63713 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:28.774696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8627324-373d-4f71-931d-8177440094fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:28.775315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627324-373d-4f71-931d-8177440094fc None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.775593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627324-373d-4f71-931d-8177440094fc None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.775865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8627324-373d-4f71-931d-8177440094fc None admin] PATH_INFO: `/v3/projects/450e1338f4c64117b7f14ea91ac86816` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.776987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627324-373d-4f71-931d-8177440094fc None admin] RBAC: Authorizing `identity:get_project(project_id=450e1338f4c64117b7f14ea91ac86816)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:28.778417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8627324-373d-4f71-931d-8177440094fc None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:28.780061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 592/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:01:28 2022] GET /identity/v3/projects/450e1338f4c64117b7f14ea91ac86816 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:28.785969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:28.884250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d281f4d-06e6-42eb-a9a2-037f3257b96a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:28.886543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:28.916835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad35023-9aff-413f-8fa3-c93ca4da91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:28.917486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad35023-9aff-413f-8fa3-c93ca4da91f2 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:28.917764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad35023-9aff-413f-8fa3-c93ca4da91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:28.918040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad35023-9aff-413f-8fa3-c93ca4da91f2 None admin] PATH_INFO: `/v3/projects/450e1338f4c64117b7f14ea91ac86816/users/bc386277cebf4736bd95694880c1dd10/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:28.919911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad35023-9aff-413f-8fa3-c93ca4da91f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=450e1338f4c64117b7f14ea91ac86816, user_id=bc386277cebf4736bd95694880c1dd10, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:28.921866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad35023-9aff-413f-8fa3-c93ca4da91f2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:29.027639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 600/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:01:28 2022] PUT /identity/v3/projects/450e1338f4c64117b7f14ea91ac86816/users/bc386277cebf4736bd95694880c1dd10/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:01:31.131736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1164f-4ff4-40b7-a267-95f8aaf610bc None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.132280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1164f-4ff4-40b7-a267-95f8aaf610bc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.132369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1164f-4ff4-40b7-a267-95f8aaf610bc None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.133681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 593/1193] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:01:31.138806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.139176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.139384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.157400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:01:31.158582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:01:31.223171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 601/1194] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:01:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:01:31.490478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1164f-4ff4-40b7-a267-95f8aaf610bc None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:31.544136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:31.591214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1164f-4ff4-40b7-a267-95f8aaf610bc None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:31.623250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:31.624384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.624662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.624932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.635249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:01:31.640621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:01:31.641784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:01:31.642828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 594/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:01:31.648145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:31.737248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:31.743542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99756c5-a031-466c-bd96-b7bad667c9ae None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:31.777200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:31.777802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.778078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.778348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.778999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:31.779301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:31.780709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:31.788385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 602/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:31.794304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:31.892472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419819a-76da-4c5d-bb7a-e579aba69d9f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:31.904923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:31.925723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:31.926374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:31.926655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:31.926933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] PATH_INFO: `/v3/users/bc386277cebf4736bd95694880c1dd10` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:31.928034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] RBAC: Authorizing `identity:get_user(user_id=bc386277cebf4736bd95694880c1dd10)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:31.929540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:31.931154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 595/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Wed Sep 7 13:01:31 2022] GET /identity/v3/users/bc386277cebf4736bd95694880c1dd10 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:31.937582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:32.034499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491debc-1823-491e-8945-1adb14de45fa None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:32.067974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:32.068595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:32.068871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:32.069143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:32.093020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:32.135377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:32.136847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:32.231494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 603/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:01:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:01:32.238095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:32.335529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19781651-136f-48ba-9eed-9de2731f1764 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:32.367089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02c6a-a692-4f9a-895f-53ecac22944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:32.367697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02c6a-a692-4f9a-895f-53ecac22944a None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:32.367972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02c6a-a692-4f9a-895f-53ecac22944a None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:32.368267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02c6a-a692-4f9a-895f-53ecac22944a None admin] PATH_INFO: `/v3/projects/450e1338f4c64117b7f14ea91ac86816` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:32.369349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02c6a-a692-4f9a-895f-53ecac22944a None admin] RBAC: Authorizing `identity:get_project(project_id=450e1338f4c64117b7f14ea91ac86816)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:32.370760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02c6a-a692-4f9a-895f-53ecac22944a None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:32.372489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 596/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Wed Sep 7 13:01:32 2022] GET /identity/v3/projects/450e1338f4c64117b7f14ea91ac86816 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:32.379060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:01:32.435200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:32.479016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84786183-9070-49c3-b7fb-053fe8ab13c9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:01:32.511611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:01:32.512269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:01:32.512511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:01:32.512776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:01:32.513516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=450e1338f4c64117b7f14ea91ac86816, user.id=bc386277cebf4736bd95694880c1dd10) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:01:32.513818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:01:32.515805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042001d4-c8a4-4e40-bdee-b5934e7ddf18 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:01:32.521771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 604/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:01:32 2022] GET /identity/v3/role_assignments?user.id=bc386277cebf4736bd95694880c1dd10&scope.project.id=450e1338f4c64117b7f14ea91ac86816&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:01:42.363067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=76 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:01:42.518883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=40 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:46.564181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477c50-bd56-4472-a32e-f6244a3d9de9 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:46.564774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477c50-bd56-4472-a32e-f6244a3d9de9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:46.564774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23477c50-bd56-4472-a32e-f6244a3d9de9 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:46.566213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 597/1201] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:46.571639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:46.572076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:46.572219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:46.589972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:46.591132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:46.658862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 605/1202] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:02:46.942444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477c50-bd56-4472-a32e-f6244a3d9de9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:47.043054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23477c50-bd56-4472-a32e-f6244a3d9de9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:47.077293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:47.078360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:47.078704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:47.078976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:47.089141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:47.090576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:02:47.104812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:47.106140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:02:47.107146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:02:47.107146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:47.107146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:02:47.107146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 598/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:47.113063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:47.211871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c51bca-e8bc-49d5-b8ad-a67ab020d651 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:47.239954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:47.245316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:47.245917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:47.246224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:47.246487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:47.247148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:47.247441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:47.249328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7926877-eb79-42b1-bab6-ab5b56ee07b4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:47.260138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 606/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:47.266516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:47.318368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:47.363646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45db700-2928-4766-8914-712b9a68ae62 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:47.395897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cecfd4b-9fac-4f6b-82b0-30482999098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:47.396527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecfd4b-9fac-4f6b-82b0-30482999098e None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:47.396801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecfd4b-9fac-4f6b-82b0-30482999098e None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:47.397066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cecfd4b-9fac-4f6b-82b0-30482999098e None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:47.397706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecfd4b-9fac-4f6b-82b0-30482999098e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:47.399389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cecfd4b-9fac-4f6b-82b0-30482999098e None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:47.495548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 599/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Wed Sep 7 13:02:47 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:02:49.669368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbe266-82b2-44ae-b8c4-c4e8ce14dd1c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:49.669784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbe266-82b2-44ae-b8c4-c4e8ce14dd1c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:49.669887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbe266-82b2-44ae-b8c4-c4e8ce14dd1c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:49.671921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 607/1206] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:49.677070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:49.680212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:49.680212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:49.695543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:49.696759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:49.763070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 600/1207] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:02:50.036924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbe266-82b2-44ae-b8c4-c4e8ce14dd1c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:50.140286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbe266-82b2-44ae-b8c4-c4e8ce14dd1c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:50.174082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:50.174703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:50.174978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:50.175244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:50.185072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:02:50.189794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:50.190956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:50.192015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 608/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 13:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:50.197228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:50.238903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:50.296665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac416203-b481-4778-b4b4-9274c7c494fc None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:50.329842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:50.330432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:50.330757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:50.331028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:50.331673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:50.331969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:50.333358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:50.340910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 601/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 13:02:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:50.347263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:50.397055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:50.447465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a714f4f-3f60-42e8-8b65-cfc489bc2c56 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:50.480427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:50.481094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:50.481568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:50.482369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:50.493530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:50.494958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:02:50.508891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:50.516651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:02:50.517685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:02:50.517685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:50.517685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:50.517685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 609/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:50.517926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:50.612533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:50.615320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e463e-778f-43ef-9f48-32ce002e8efd None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:50.649375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:50.649980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:50.650263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:50.650570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:50.651219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:50.651518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:50.652920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:50.665020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 602/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:50.670766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:50.769935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eca738-1ee3-4623-805c-f4890710ec07 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:50.771774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:50.807146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:50.807788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:50.808057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:50.808353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] PATH_INFO: `/v3/users/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:50.817905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:50.819868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:02:50.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:50.833231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:50.834466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 610/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:50.839716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:50.940449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030416e-dff4-4943-9202-34a32c085798 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:50.973361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:50.973960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:50.974270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:50.974503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:50.975211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:50.975512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:50.976959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:50.995408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 603/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 7 13:02:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:51.001685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:51.101136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823313cd-eef8-477c-ab28-7829030cd6de None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:51.135272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:51.135878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:51.136179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:51.136447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:51.166236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:51.203608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:51.205007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:51.299326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 611/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:02:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:02:51.304245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:51.322587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:51.400167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df22a6e-3807-4e71-beea-6da02a7bdd04 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:51.434667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:51.435286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:51.435556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:51.435889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:51.445700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:51.447177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:02:51.461806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:51.462973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:02:51.464126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:02:51.464126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:51.464126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:02:51.464126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 604/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:51.469349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:51.530441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:51.567964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed3450-a261-48d8-861e-b1a816fcdcda None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:51.600900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:51.601555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:51.601809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:51.602046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:51.606603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:51.606603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:51.606603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:51.615739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 612/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:51.621535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:51.692070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:51.722460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab5188-ede9-4059-9fa1-ecd10496e7e6 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:51.755480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:51.756126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:51.756407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:51.756675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:51.763292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:51.765358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:02:51.777236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:51.778305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:02:51.779561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 605/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:51.784283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:51.883967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ecc30-1356-4922-8567-faac4374ccd8 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:51.906755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:51.918197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:51.918841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:51.919112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:51.919383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:51.920068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:51.920402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:51.921832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c6db7-6187-4519-8631-4644fc8c8932 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:51.933054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 613/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:51.939971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:52.038368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73293d9d-f4aa-4d89-bfaa-86c6adf38ea1 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:52.067144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:52.072904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:52.073503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:52.073778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:52.074048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:52.074763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:52.075067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:52.077039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11460392-24f0-43bf-87dc-b5418718d305 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:52.082253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 606/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:02:51 2022] GET /identity/v3/role_assignments?user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:54.244404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff5e7-4156-43e2-8b78-fc2046b32910 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:54.244962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff5e7-4156-43e2-8b78-fc2046b32910 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:54.244962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ff5e7-4156-43e2-8b78-fc2046b32910 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:54.246294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 614/1220] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:54.251582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:54.254444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:54.254444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:54.269887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:54.271067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:54.336202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 607/1221] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:02:54.608194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff5e7-4156-43e2-8b78-fc2046b32910 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:54.712798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ff5e7-4156-43e2-8b78-fc2046b32910 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:54.746644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:54.747263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:54.747537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:54.747807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:54.757716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:02:54.762554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:54.763648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:54.764689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 615/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 13:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:54.769816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:54.868615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f70cf-5151-4f0a-b6de-51f05c95d94b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:54.891792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:54.902383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:54.902994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:54.903267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:54.903537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:54.905018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] RBAC: Adding query filter params (name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:54.905335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:54.906711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:54.914419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 608/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 13:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:54.921253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:54.963881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:55.018901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb643c2-6a30-484b-a361-e7e943e84c36 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:55.054521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:55.055151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.055447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.055714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.065586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:55.067021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:02:55.081511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:55.082633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:02:55.083694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:02:55.083694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:55.083694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:55.083694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 616/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:55.088429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.187894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9603c-36f2-45a1-b2c9-4a57f20ad089 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:55.221760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:55.222352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.222624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.222889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.223513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:55.223870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:55.225260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:55.236780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 609/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:55.242685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.335179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:55.341749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17c5ac-18ac-4c93-b151-d228158e2a7d None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:55.375720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:55.376423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.381841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.381841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.383627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:55.385135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:02:55.396376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:55.402678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:55.403971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 617/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:55.405377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.452379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:55.505299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b99d-64a2-46c6-824a-3c08a3f02b2c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:55.539247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:55.539846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.540145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.540420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.541142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:55.541442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:55.542907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:55.560829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 610/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:55.569636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.671506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48166d62-b963-4d6e-8a82-3943d42f013b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:55.704674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:55.705242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.705518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.705784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.716795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:55.718876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:02:55.732964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:55.734113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:02:55.735015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:02:55.735015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:55.735015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:55.735015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 618/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:55.740073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.838998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25f8db-5205-4832-b38b-0c0298693911 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:55.841315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:55.871958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:55.872593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:55.872870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:55.873824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:55.874475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:55.874791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:55.876164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:55.888108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 611/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:55.894254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:55.904770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:55.996967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e416-4120-4b7a-8edf-4fcc4980cdad None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:56.031087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:56.031708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:56.031983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:56.032282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:56.038767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:56.040321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:02:56.051718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:56.052691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:02:56.053740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 619/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:56.058814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:56.157997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf223922-62b9-48bd-966e-76f001346499 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:56.190889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:56.191482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:56.191755 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:56.192022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:56.192728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:56.193025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:56.194433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e51ce-be5d-4d6e-8118-acf7c0ebc737 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:56.206150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 612/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:02:56.212311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:56.279946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:56.315282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138758a-0b9c-441f-8b50-b6a39ca27ad9 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:56.349015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a55a63-599d-4eb8-a770-5f6e4fce40d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:56.349860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a55a63-599d-4eb8-a770-5f6e4fce40d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:56.350134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a55a63-599d-4eb8-a770-5f6e4fce40d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:56.350414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a55a63-599d-4eb8-a770-5f6e4fce40d6 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/ef26df9666dd4e54aa9c76d4a1aa6cc8/roles/c6b9b1e611f94feaa0e6ef05cb79f640` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:56.364815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a55a63-599d-4eb8-a770-5f6e4fce40d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=ef26df9666dd4e54aa9c76d4a1aa6cc8, role_id=c6b9b1e611f94feaa0e6ef05cb79f640)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:56.368073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a55a63-599d-4eb8-a770-5f6e4fce40d6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:56.461288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 620/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:02:56 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/ef26df9666dd4e54aa9c76d4a1aa6cc8/roles/c6b9b1e611f94feaa0e6ef05cb79f640 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:02:58.619142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e567f5-5cea-4ee8-a122-cefa8ae56191 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:58.619734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e567f5-5cea-4ee8-a122-cefa8ae56191 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:58.619734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e567f5-5cea-4ee8-a122-cefa8ae56191 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:58.621090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 613/1233] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:02:58.626635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:58.627084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:58.627204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:58.645080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:02:58.646279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:02:58.712176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 621/1234] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:02:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:02:58.985055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e567f5-5cea-4ee8-a122-cefa8ae56191 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.010429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.084456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e567f5-5cea-4ee8-a122-cefa8ae56191 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.117375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.117987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.118261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.118530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.129130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:02:59.133863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:59.135003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:02:59.136027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 614/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Wed Sep 7 13:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:59.141531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.188396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.240964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748c132-4f97-4f0d-927a-fbd8a69cda0e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.273959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.274564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.274839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.275108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.275760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] RBAC: Adding query filter params (name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:59.276057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:59.277445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:59.285937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 622/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:59.291862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.376950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.392425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ef690-1a5a-42f2-a35b-703788d356ee None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.427552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.428212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.428489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.428759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.439282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:59.440764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:02:59.455168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:59.459797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:02:59.460941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:02:59.460941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:02:59.460941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:02:59.460941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 615/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:59.462073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.562614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5e1ab-aa6f-45ac-a181-b08936b8f342 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.571171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.596178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.602405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.602405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.602405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.602405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:59.602405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:59.602405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:59.611166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 623/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:02:59.617194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.719515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124f8e6-c942-4307-a664-252c42d853f0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.752196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.752817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.753093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.753361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.755993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:02:59.761186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:59.762616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:02:59.774274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:02:59.775331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:02:59.776320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 616/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:02:59.781401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:02:59.880969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1dcde4-deae-4c1d-a274-face67ccae88 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:02:59.914584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:02:59.915174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:02:59.915467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:02:59.915732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:02:59.916471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:02:59.916783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:02:59.919877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:02:59.939435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 624/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:02:59.945319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:00.043083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e097479-0e2b-4ff0-bbc6-5e9ce0d8aac3 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:00.075556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:00.076196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:00.076474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:00.076740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:00.136129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:00.142952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:00.144428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:00.240527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 617/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:02:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:00.246541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:00.274735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:00.348253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983bcc3-eda9-497a-a125-16b0f9a524e6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:00.382538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:00.383160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:00.383435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:00.383704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:00.393679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:00.395057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:00.409680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:00.416220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:00.417307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:00.417307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:00.417307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:00.417307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 625/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:00.417599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:00.508361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:00.514026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972bf7d-2ba1-4c6f-bcfb-4b4174226994 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:00.547370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:00.547967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:00.548274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:00.548549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:00.549184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:00.549487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:00.550881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:00.562492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 618/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:00.568240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:00.646215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:00.681715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af1f7c-d42f-4b5e-a54c-612a47583976 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:00.701657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:00.702289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:00.702565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:00.702861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:00.709634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:00.711064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:03:00.723321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:00.724367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:00.725292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 626/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:00.730653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:00.832037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72815f22-5337-4cc5-87ad-bfbac1997c3c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:00.865447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:00.866046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:00.866323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:00.866593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:00.867276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:00.867580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:00.869114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afb561b-2964-4c4a-b154-d621e785aefa None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:00.882313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 619/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:00.888690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:00.988754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4236053-31c6-41ab-995a-9cedff5562f7 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:01.022734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:01.023361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:01.023900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:01.024201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:01.024915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] RBAC: Adding query filter params (role.id=c6b9b1e611f94feaa0e6ef05cb79f640, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:01.025214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:01.026785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d69d-05d0-4bfc-b2cd-d70f5dc53360 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:01.032491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 627/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:03:00 2022] GET /identity/v3/role_assignments?user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=c6b9b1e611f94feaa0e6ef05cb79f640 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:03.227105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c8e62-bb38-4c28-ba1b-7ed77d13f3c6 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:03.227640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c8e62-bb38-4c28-ba1b-7ed77d13f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:03.227640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c8e62-bb38-4c28-ba1b-7ed77d13f3c6 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:03.229039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 620/1247] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:03.234754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:03.235141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:03.235302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:03.241660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:03.253617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:03.254800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:03.319288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 628/1248] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:03.586813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c8e62-bb38-4c28-ba1b-7ed77d13f3c6 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:03.605300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:03.687266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c8e62-bb38-4c28-ba1b-7ed77d13f3c6 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:03.719703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:03.720364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:03.720852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:03.721161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:03.732546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:03:03.737385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:03.738541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:03.739568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 621/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:03:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:03.744575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:03.842353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8598a9-03e6-410c-b92c-bacc48c7105f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:03.871186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:03.876661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:03.877270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:03.877545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:03.877812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:03.878468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:03.878773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:03.880150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:03.888023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 629/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:03.894644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:03.971546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:03.993398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897b922-968a-4fff-9660-e50bae260078 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:04.027156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:04.027839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:04.028149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:04.028525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:04.038847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:04.040353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:04.056270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:04.057406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:04.058654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:04.058654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:04.058654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:04.058654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 622/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:04.063785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:04.161852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f7fd1-095d-4c75-9254-e092a5d0ba39 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:04.195218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:04.195816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:04.196102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:04.196369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:04.196991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:04.197284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:04.198622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:04.210225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 630/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:04.215974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:04.314196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79393549-a78d-4393-bc38-4f3945a3dae7 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:04.339404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.346894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693196-797f-4130-928d-c2326655a7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:04.347509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693196-797f-4130-928d-c2326655a7da None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:04.347780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693196-797f-4130-928d-c2326655a7da None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:04.348192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6693196-797f-4130-928d-c2326655a7da None admin] PATH_INFO: `/v3/users/placement` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:04.355338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6693196-797f-4130-928d-c2326655a7da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:04.356866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6693196-797f-4130-928d-c2326655a7da None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-b6693196-797f-4130-928d-c2326655a7da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:03:04.367945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:04.374545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:04.375718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 623/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:04.376539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:04.430846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.473631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b5cde-74cb-44a4-a1c9-4ea0d6b04a38 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:04.506319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:04.506931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:04.507206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:04.507474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:04.508280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:04.508586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:04.509991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:04.528605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 631/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 7 13:03:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:03:04.534677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693196-797f-4130-928d-c2326655a7da None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:04.635255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6693196-797f-4130-928d-c2326655a7da None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:04.671002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:04.671615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:04.671893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:04.672198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:04.726909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.739084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:04.740563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:04.838273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 624/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:03:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:04.845072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:04.945917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90d763-db23-469d-9c18-2405de1e3875 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:04.959176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:04.980593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:04.981154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:04.981428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:04.981697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:04.991579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:04.993076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:05.007389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:05.008556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:05.009825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:05.009825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:05.009825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:05.009825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 632/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:05.014974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:05.104219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:05.116046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1b2e4-5886-4bb6-935c-257f48b27ca0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:05.149254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:05.149846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:05.150145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:05.150410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:05.151036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:05.151332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:05.152712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:05.163711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 625/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:05.170417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:05.271683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79377e29-e3ff-4222-a3e9-466ee65704fd None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:05.304537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:05.305213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:05.305491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:05.305769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:05.312961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:05.314404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:03:05.325447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:05.327114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:05.328194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 633/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:05.333221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:05.429285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d18bf-f8e6-4ef6-af68-ebdc120c699b None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:05.466369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:05.467671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:05.467936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:05.468288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:05.469061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:05.469603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:05.471964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b0934-0a8b-4aa4-aafd-a455072b7529 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:05.486544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 626/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:05.492631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:05.517731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:05.589432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b17bf-8430-43d3-8ae6-4c8af69a33a0 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:05.622988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:05.623647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:05.627308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:05.627308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:05.627308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:05.627308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:05.627308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8233c9-7d2e-4ecf-ad99-bd3d29b354d9 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:05.631951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 634/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:03:05 2022] GET /identity/v3/role_assignments?user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:07.750079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5ff3-fe5d-4206-b080-3421bac93271 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:07.750600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5ff3-fe5d-4206-b080-3421bac93271 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:07.750600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d5ff3-fe5d-4206-b080-3421bac93271 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:07.751957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 627/1261] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:07.757327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:07.757731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:07.757890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:07.776527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:07.777868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:07.847514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 635/1262] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:08.123692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d5ff3-fe5d-4206-b080-3421bac93271 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:08.134375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:08.231638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d5ff3-fe5d-4206-b080-3421bac93271 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:08.265643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:08.266262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:08.266534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:08.266823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:08.276857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:03:08.281578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:08.282686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:08.283770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 628/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:08.288855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:08.307230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:08.385880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1e8d4-5cb5-463b-9b9a-68177f1fc579 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:08.420808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:08.421396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:08.421667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:08.421928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:08.422596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:08.422891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:08.424359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:08.432300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 636/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:03:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:08.438157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:08.506823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:08.540527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6a2e-bf45-40ef-b6f9-c728a1bcc215 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:08.575181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:08.575802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:08.576075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:08.576919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:08.587001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:08.588574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:08.602791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:08.604003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:08.605152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:08.605152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:08.605152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:08.605152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 629/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:08.609736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:08.693995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:08.713047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be6920-bf3e-404e-ba10-bb94298eff51 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:08.745984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:08.746586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:08.746863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:08.747131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:08.747763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:08.748064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:08.749442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:08.760256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 637/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:08.766496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:08.871753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df61b-7f23-4d95-853b-7e59f95858eb None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:08.892765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:08.907370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:08.907992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:08.908295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:08.908562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:08.917252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:08.917396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:03:08.928289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:08.929381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:08.930532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 630/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:08.936066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:09.037648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd769b-29f1-4557-9f25-d4465ebd9d82 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:09.071018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:09.071613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:09.071887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:09.072182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:09.072939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:09.073239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:09.074720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:09.084071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:09.092631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 638/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 7 13:03:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:09.098651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:09.198092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911c5af-eb3e-4e41-a04c-3a713590b8b8 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:09.231832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:09.233090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:09.233370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:09.233642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:09.244044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:09.245520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:09.260714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:09.261839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:09.262944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:09.262944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:09.262944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:09.262944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 631/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:09.267640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:09.367882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b033aa-f823-420d-8bdf-77b9d2c376ff None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:09.401531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:09.402132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:09.402406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:09.402699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:09.403329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:09.403628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:09.405605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:09.416676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 639/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:09.422536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:09.454860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:09.521498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4137e5-156b-48bd-b439-b7d232c49825 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:09.555657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:09.556301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:09.556580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:09.556865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:09.563433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:09.564903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:03:09.576064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:09.577833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:09.579117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 632/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:09.583559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:09.640918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:09.682662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4f6cab-469e-475b-8fc0-700d7ba9f0b6 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:09.717640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:09.718173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:09.718444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:09.718705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:09.719395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:09.719677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:09.721177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4662059-6586-406d-aaf8-d3017c546d0a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:09.734154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 640/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:09.740246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:09.832960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:09.842021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c1d39-8f97-475c-83fd-e14295e2188c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:09.874725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15385c7-339d-4062-9273-0ad2b5ad2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:09.875373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15385c7-339d-4062-9273-0ad2b5ad2619 None admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:09.875649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15385c7-339d-4062-9273-0ad2b5ad2619 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:09.875911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15385c7-339d-4062-9273-0ad2b5ad2619 None admin] PATH_INFO: `/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/ef26df9666dd4e54aa9c76d4a1aa6cc8/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:09.877847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15385c7-339d-4062-9273-0ad2b5ad2619 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user_id=ef26df9666dd4e54aa9c76d4a1aa6cc8, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:09.879262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15385c7-339d-4062-9273-0ad2b5ad2619 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:09.987981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 633/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Wed Sep 7 13:03:09 2022] PUT /identity/v3/projects/ae0bcc53fe7047d6ba6b8fc8e5e4bdd7/users/ef26df9666dd4e54aa9c76d4a1aa6cc8/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:03:12.133712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b1042-9feb-43a4-b976-942ba8ed34d8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:12.134271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b1042-9feb-43a4-b976-942ba8ed34d8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:12.134271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b1042-9feb-43a4-b976-942ba8ed34d8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:12.135574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 641/1274] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:12.141880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:12.142297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:12.142499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:12.160817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:12.161998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:12.227869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 634/1275] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:12.495338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b1042-9feb-43a4-b976-942ba8ed34d8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:12.597597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b1042-9feb-43a4-b976-942ba8ed34d8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:12.614707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:12.631224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:12.644841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:12.644841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:12.644841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:12.644841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 07 13:03:12.646753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:12.647939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:12.649187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 642/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Wed Sep 7 13:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:12.654187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:12.737844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:12.756438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640af10-4e69-4caa-8ab4-0874801c3a91 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:12.788599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:12.789198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:12.789476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:12.789746 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:12.790398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:12.790699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:12.792157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:12.800650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 635/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Wed Sep 7 13:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:12.806773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:12.903964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cfdf1-8030-4751-aee4-0b9cb32f737c None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:12.937917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:12.938572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:12.938848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:12.939158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:12.948947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:12.950542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:12.964792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:12.965845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:12.967388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:12.967388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:12.967388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:12.967388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 643/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:12.972257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:13.071167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038f6ee-b0dc-4dcd-bb79-7b13064c1db0 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:13.103960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:13.104598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:13.104877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:13.105147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:13.105779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:13.106079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:13.107972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:13.119687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 636/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:13.126215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:13.158783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:13.227028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c231b2-6c17-46ed-a0d8-4ada5e83dacc None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:13.260187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:13.260807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:13.261077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:13.261339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:13.268611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:13.270029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 07 13:03:13.282572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:13.283725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:13.284861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 644/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:13.289608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:13.293417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:13.387237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e630288-479d-4e1e-9711-6e006112f114 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:13.420680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:13.421275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:13.421548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:13.421816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:13.422526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:13.422838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:13.424269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:13.442084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 637/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Wed Sep 7 13:03:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:13.447997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:13.539878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:13.549111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8dca7-783b-4a2e-bd03-bf1c553f753f None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:13.583302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:13.583900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:13.584199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:13.584464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:13.650369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:13.651795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:13.738911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:13.749331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 645/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Wed Sep 7 13:03:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 07 13:03:13.755185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:13.815923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:13.853586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24ca43-a9f4-45cf-b18c-384c31722f3f None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:13.884998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:13.885612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:13.885883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:13.886147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:13.896899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:13.898319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 07 13:03:13.913544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:13.914708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 07 13:03:13.916116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 07 13:03:13.916116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 07 13:03:13.916116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:13.916116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 638/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 07 13:03:13.920578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:14.020148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb922d63-b84e-45a4-8af9-adcf6bbe117b None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:14.055818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:14.056441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:14.056712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:14.056977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:14.057603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:14.057898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:14.059239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:14.072021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 646/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Wed Sep 7 13:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:03:14.077878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:14.178976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd22473-b98d-4084-a822-d2db13ccf5e2 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:14.192243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:14.211370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:14.211982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:14.212283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:14.212547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:14.219489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:14.220969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 07 13:03:14.231772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:14.232852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: ERROR keystone.server.flask.application Sep 07 13:03:14.233774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 639/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Wed Sep 7 13:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:14.238884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:14.288550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:14.337727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b18880-ab37-4876-a0c8-d9bd7d18aed1 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:14.369863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:14.370463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:14.370738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:14.371005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:14.371687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:14.371989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:14.373942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af7cc-8338-4f15-b253-4965c01797f4 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:14.385737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 647/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Wed Sep 7 13:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:14.392538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:14.489518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe88d3-129d-4b37-97df-5489e637ac06 None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:14.523532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:14.524408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:14.524685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:14.524955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:14.525668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] RBAC: Adding query filter params (role.id=ea3827124d3f4fa689b3cf4cbe7530e8, scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7, user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:14.525972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:14.527402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b5d95-d4a5-4b9c-aa89-cbf4ecf22be7 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:14.533131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 640/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Wed Sep 7 13:03:14 2022] GET /identity/v3/role_assignments?user.id=ef26df9666dd4e54aa9c76d4a1aa6cc8&scope.project.id=ae0bcc53fe7047d6ba6b8fc8e5e4bdd7&role.id=ea3827124d3f4fa689b3cf4cbe7530e8 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:16.725573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1520c7-5338-4162-812e-814ac3ba6f34 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:16.726102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1520c7-5338-4162-812e-814ac3ba6f34 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:16.726102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1520c7-5338-4162-812e-814ac3ba6f34 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:16.727588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 648/1288] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:16.732863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:16.733301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:16.733395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:16.751767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:16.752992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:16.782609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:16.819492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 641/1289] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:17.097966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1520c7-5338-4162-812e-814ac3ba6f34 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:17.199151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1520c7-5338-4162-812e-814ac3ba6f34 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:17.210712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:17.233397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:17.234025 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:17.234295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:17.234561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:17.235132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:17.236676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:17.245510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:17.246574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:17.247740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 649/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:03:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:17.253356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:17.350879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb15f-011e-4587-8fce-0255836077ea None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:17.384199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:17.384814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:17.385132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:17.385408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:17.386027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:17.386328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:17.387687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843605e-f296-4bf8-bbd2-bd64d6587d8b None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:17.392979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 642/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 7 13:03:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:17.399291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:17.499524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbd676-2b37-40bb-8b58-39be205e01c2 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:17.533845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:17.534441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:17.534717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:17.534982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] PATH_INFO: `/v3/services` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:17.535600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:17.535897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:17.537440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202e0d-75ef-4a32-8a55-7feb6d8f5585 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:17.541914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 650/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 7 13:03:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:19.681627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98d295-4e13-4853-aabc-fd5ccd06889f None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:19.685870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98d295-4e13-4853-aabc-fd5ccd06889f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:19.685870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98d295-4e13-4853-aabc-fd5ccd06889f None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:19.685870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 643/1293] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:19.688702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6dcf1-fa5f-42a4-b719-e3fcbe90555c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:19.689147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6dcf1-fa5f-42a4-b719-e3fcbe90555c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:19.689250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6dcf1-fa5f-42a4-b719-e3fcbe90555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:19.707662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-09b6dcf1-fa5f-42a4-b719-e3fcbe90555c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:19.708890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-09b6dcf1-fa5f-42a4-b719-e3fcbe90555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:19.738269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:19.773189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 651/1294] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:20.043366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98d295-4e13-4853-aabc-fd5ccd06889f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:20.079312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:20.150656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98d295-4e13-4853-aabc-fd5ccd06889f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:20.183902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcdbf2-a3cf-40c9-a0f1-450a0b8a5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:20.184533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcdbf2-a3cf-40c9-a0f1-450a0b8a5fe0 None admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:20.184809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcdbf2-a3cf-40c9-a0f1-450a0b8a5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:20.185081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcdbf2-a3cf-40c9-a0f1-450a0b8a5fe0 None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:20.186299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcdbf2-a3cf-40c9-a0f1-450a0b8a5fe0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:20.187669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcdbf2-a3cf-40c9-a0f1-450a0b8a5fe0 None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:20.276319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 644/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Wed Sep 7 13:03:20 2022] POST /identity/v3/services => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:03:22.447704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f61f2-85a1-4bcf-8072-dcf411d0d225 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:22.448282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f61f2-85a1-4bcf-8072-dcf411d0d225 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:22.448282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f61f2-85a1-4bcf-8072-dcf411d0d225 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:22.449665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 652/1296] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:22.455672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:22.456121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:22.456234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:22.474011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:22.475188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:22.546101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 645/1297] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:22.814548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f61f2-85a1-4bcf-8072-dcf411d0d225 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:22.913518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f61f2-85a1-4bcf-8072-dcf411d0d225 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:22.947179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:22.947829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:22.948060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:22.948358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:22.948928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:22.950273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:22.958886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:22.960152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:22.961215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 653/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:03:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:22.966103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:22.984504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:23.065191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749c21-18b6-4a3d-ac17-8318c9829423 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:23.098573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:23.099173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:23.099450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:23.099718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:23.100377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:23.100687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:23.102057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:23.107103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 646/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 7 13:03:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:23.113085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:23.144203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:23.215841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682079a-a9f8-4247-97ca-1ed8a180802a None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:23.250309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:23.251256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:23.251530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:23.251797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:23.252839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] RBAC: Adding query filter params (interface=public, service_id=138fc86d1dfc4372a947612f9663ed52, region_id=RegionOne) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:23.253145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:23.255002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98b54d-6dc5-48e5-a0cc-e2e0195bb361 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:23.260462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 654/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Wed Sep 7 13:03:23 2022] GET /identity/v3/endpoints?service_id=138fc86d1dfc4372a947612f9663ed52&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:03:23.266474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:23.347665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:23.365159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb7de-184a-42c8-aa15-8db1df3b008c None admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:23.397262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd3941-1f4e-4720-a126-00000100c64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:23.397890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3941-1f4e-4720-a126-00000100c64c None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:23.398137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3941-1f4e-4720-a126-00000100c64c None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:23.398406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd3941-1f4e-4720-a126-00000100c64c None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:23.399003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd3941-1f4e-4720-a126-00000100c64c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:23.400669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd3941-1f4e-4720-a126-00000100c64c None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:23.407803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 647/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Wed Sep 7 13:03:23 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:03:25.563077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a2275-2438-4a0b-8698-6a377274889b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:25.563662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a2275-2438-4a0b-8698-6a377274889b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:25.563662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a2275-2438-4a0b-8698-6a377274889b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:25.564996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 655/1302] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:03:25.570127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:25.570530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:25.570677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:25.588571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:03:25.589745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:03:25.656420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 648/1303] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:03:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 07 13:03:25.922360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a2275-2438-4a0b-8698-6a377274889b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:26.016138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:26.022751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a2275-2438-4a0b-8698-6a377274889b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:26.056747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:26.057369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:26.057719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:26.057989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:26.058558 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:26.059961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 07 13:03:26.068410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 07 13:03:26.069549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.get_or_create( Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application with Lock( Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self._enter() Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application return self.creator() Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application created_value = creator( Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: ERROR keystone.server.flask.application Sep 07 13:03:26.070409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 656/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Wed Sep 7 13:03:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 07 13:03:26.075674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:26.154128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:26.178638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444bb70-0747-4b27-9268-c62bc0f47799 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:26.213444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:26.214038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:26.214317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:26.214588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] PATH_INFO: `/v3/services` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:26.215207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:03:26.215506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:26.216943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c618d4-5041-4eea-a01d-56d4e2383a1d None admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:26.221921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 649/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Wed Sep 7 13:03:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:03:26.227809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:03:26.328031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec970f-ccf7-4f32-997d-917d153e9b56 None admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:03:26.365200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ed961-2223-4beb-8f8c-357e23f908ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:03:26.365811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed961-2223-4beb-8f8c-357e23f908ca None admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:03:26.366089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed961-2223-4beb-8f8c-357e23f908ca None admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:03:26.366355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ed961-2223-4beb-8f8c-357e23f908ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:03:26.367004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ed961-2223-4beb-8f8c-357e23f908ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:03:26.368383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ed961-2223-4beb-8f8c-357e23f908ca None admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:03:26.461716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 657/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:03:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:03:36.250250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=30 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:03:36.457151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:41.552809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf54e-f717-4503-9501-ee49b9aaf604 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:41.553298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf54e-f717-4503-9501-ee49b9aaf604 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:41.553856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cf54e-f717-4503-9501-ee49b9aaf604 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:41.555020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 650/1307] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:41.561198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c006-2acf-4804-8f57-931d20d161fa None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:41.561663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c006-2acf-4804-8f57-931d20d161fa None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:41.562329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c006-2acf-4804-8f57-931d20d161fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:41.702930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ecc0c006-2acf-4804-8f57-931d20d161fa None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:41.704206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ecc0c006-2acf-4804-8f57-931d20d161fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:41.829928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 658/1308] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:42.128356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c95f-2475-4094-99ee-141bca71124c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:42.128730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c95f-2475-4094-99ee-141bca71124c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:42.129118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738c95f-2475-4094-99ee-141bca71124c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:42.131035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 651/1309] 10.222.0.57 () {54 vars in 965 bytes} [Wed Sep 7 13:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:42.137652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20c330-9462-40f5-8688-18c4e67d5d19 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:42.138024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20c330-9462-40f5-8688-18c4e67d5d19 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:42.138526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20c330-9462-40f5-8688-18c4e67d5d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:42.227610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ef20c330-9462-40f5-8688-18c4e67d5d19 None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:42.229006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ef20c330-9462-40f5-8688-18c4e67d5d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:42.253397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:42.318127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 659/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Wed Sep 7 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:42.327057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c95f-2475-4094-99ee-141bca71124c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:42.329055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7738c95f-2475-4094-99ee-141bca71124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:42.444712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738c95f-2475-4094-99ee-141bca71124c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:42.524412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:42.525032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:42.525381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:42.525719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:42.527495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:42.585213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:42.644501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:42.648117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf08b-7a7c-4d75-94ca-c66292dca931 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:42.668751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 652/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:45.145601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67c20-4d22-49cd-aac0-890be07f490a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:45.146197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67c20-4d22-49cd-aac0-890be07f490a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:45.146197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b67c20-4d22-49cd-aac0-890be07f490a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:45.147486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 660/1312] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:45.153622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc951b4-49ee-47bd-962f-13cfed2a8723 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:45.154014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc951b4-49ee-47bd-962f-13cfed2a8723 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:45.154162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc951b4-49ee-47bd-962f-13cfed2a8723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:45.225575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4dc951b4-49ee-47bd-962f-13cfed2a8723 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:45.226708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4dc951b4-49ee-47bd-962f-13cfed2a8723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:45.328612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 653/1313] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:45.610890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b67c20-4d22-49cd-aac0-890be07f490a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:45.612468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61b67c20-4d22-49cd-aac0-890be07f490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:45.723406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b67c20-4d22-49cd-aac0-890be07f490a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:45.797402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:45.800362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:45.801045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:45.801316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:45.801577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:45.803368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:45.919500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:45.920981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c397b9-6352-4425-8d17-2103a49d7af9 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:45.939010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 661/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:48.632665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bf681-b8ad-4f19-87a9-91578dddd9e3 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:48.633205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bf681-b8ad-4f19-87a9-91578dddd9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:48.633205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bf681-b8ad-4f19-87a9-91578dddd9e3 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:48.634564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 654/1315] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:48.640403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2f08-fd8d-48db-8c8c-ca454b9fea0d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:48.640808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2f08-fd8d-48db-8c8c-ca454b9fea0d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:48.640949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d2f08-fd8d-48db-8c8c-ca454b9fea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:48.706407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-859d2f08-fd8d-48db-8c8c-ca454b9fea0d None None] MFA Rules not processed for user `0288e290a4f449a08f479aef090aafb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:48.707637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-859d2f08-fd8d-48db-8c8c-ca454b9fea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:48.759764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:48.803964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 662/1316] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:49.090294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bf681-b8ad-4f19-87a9-91578dddd9e3 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:49.091881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-757bf681-b8ad-4f19-87a9-91578dddd9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:49.101735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:49.194682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757bf681-b8ad-4f19-87a9-91578dddd9e3 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:49.266893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:49.267490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:49.267767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:49.268034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:49.269653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:49.331064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:49.377238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:49.378665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a2a92-3bb2-4234-b8d8-cf32742cd35a service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:49.396952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 655/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:52.534657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ad16a-7d3a-4ade-bc78-2d11e348bf1d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:52.535198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ad16a-7d3a-4ade-bc78-2d11e348bf1d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:52.535198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ad16a-7d3a-4ade-bc78-2d11e348bf1d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:52.536644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 663/1318] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:52.541847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01029ac7-6f62-4d9e-bf53-fd66c75456f1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:52.542287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01029ac7-6f62-4d9e-bf53-fd66c75456f1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:52.542385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01029ac7-6f62-4d9e-bf53-fd66c75456f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:52.608679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-01029ac7-6f62-4d9e-bf53-fd66c75456f1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:52.609883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-01029ac7-6f62-4d9e-bf53-fd66c75456f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:52.706145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 656/1319] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:52.987810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ad16a-7d3a-4ade-bc78-2d11e348bf1d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:52.989453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd0ad16a-7d3a-4ade-bc78-2d11e348bf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:53.089956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ad16a-7d3a-4ade-bc78-2d11e348bf1d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:53.162873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:53.163409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:53.163687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:53.163957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:53.165616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:53.173193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:53.291877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:53.293399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abf04f-a3fe-4cdd-874d-18b316597e3b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:53.312706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 664/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:10:56.764259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4f7d3-c058-4059-993e-fbfd286bc3d6 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.764821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4f7d3-c058-4059-993e-fbfd286bc3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.764821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4f7d3-c058-4059-993e-fbfd286bc3d6 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.766172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 657/1321] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:56.771478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb7877-7eb8-4b05-b6e5-0f019645a99f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:56.771893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb7877-7eb8-4b05-b6e5-0f019645a99f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:56.772003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb7877-7eb8-4b05-b6e5-0f019645a99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:56.838703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-82cb7877-7eb8-4b05-b6e5-0f019645a99f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:56.839908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-82cb7877-7eb8-4b05-b6e5-0f019645a99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:56.906225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:56.950220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 665/1322] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:57.251445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c238a75-e1c7-48b6-a144-a6bc6d3f6626 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:57.251829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c238a75-e1c7-48b6-a144-a6bc6d3f6626 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:57.252226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c238a75-e1c7-48b6-a144-a6bc6d3f6626 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:57.253662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 658/1323] 10.222.0.57 () {54 vars in 965 bytes} [Wed Sep 7 13:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:10:57.259416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978ff7-983e-4635-9ec1-c177e5b6afa5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:57.259700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978ff7-983e-4635-9ec1-c177e5b6afa5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:57.260034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978ff7-983e-4635-9ec1-c177e5b6afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:57.353844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-df978ff7-983e-4635-9ec1-c177e5b6afa5 None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:10:57.354968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-df978ff7-983e-4635-9ec1-c177e5b6afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:57.434186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 666/1324] 10.222.0.57 () {58 vars in 1062 bytes} [Wed Sep 7 13:10:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:10:57.443703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c238a75-e1c7-48b6-a144-a6bc6d3f6626 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:10:57.445311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0c238a75-e1c7-48b6-a144-a6bc6d3f6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:57.464384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:57.549507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c238a75-e1c7-48b6-a144-a6bc6d3f6626 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:10:57.624579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:10:57.625297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:10:57.625569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:10:57.625855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:10:57.627509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:10:57.703544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:10:57.740655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:10:57.742237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab482fb-3b14-42b8-ba7e-a44465f60f64 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:10:57.761349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 659/1325] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:00.226634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaa400-070b-4898-8e78-d69016fc29f8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:00.227151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaa400-070b-4898-8e78-d69016fc29f8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:00.227151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaa400-070b-4898-8e78-d69016fc29f8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:00.228503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 667/1326] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:00.235583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df6ee-b4c4-49c2-bc5e-e456a482424a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:00.235583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df6ee-b4c4-49c2-bc5e-e456a482424a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:00.235583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393df6ee-b4c4-49c2-bc5e-e456a482424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:00.301435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-393df6ee-b4c4-49c2-bc5e-e456a482424a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:00.302665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-393df6ee-b4c4-49c2-bc5e-e456a482424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:00.406270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 660/1327] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:00.695852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaa400-070b-4898-8e78-d69016fc29f8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:00.697404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3cdaa400-070b-4898-8e78-d69016fc29f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:00.757862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:00.801654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdaa400-070b-4898-8e78-d69016fc29f8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:00.877797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:00.878407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:00.878682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:00.878950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:00.880547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:00.987871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:00.990136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:00.991573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f307b74-24a0-49e5-be75-d35a32342d1f service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:01.010178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 668/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:03.240519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915dcf-5c72-4e43-9683-a14e72156291 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:03.240981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915dcf-5c72-4e43-9683-a14e72156291 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:03.241062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915dcf-5c72-4e43-9683-a14e72156291 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:03.242450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 661/1329] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:03.248241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadefc8-c192-4497-8edb-bb6589236823 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:03.248735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadefc8-c192-4497-8edb-bb6589236823 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:03.248839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadefc8-c192-4497-8edb-bb6589236823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:03.333816 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5eadefc8-c192-4497-8edb-bb6589236823 None None] MFA Rules not processed for user `0288e290a4f449a08f479aef090aafb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:03.335037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5eadefc8-c192-4497-8edb-bb6589236823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:03.556585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 669/1330] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:03.840771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915dcf-5c72-4e43-9683-a14e72156291 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:03.842855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-88915dcf-5c72-4e43-9683-a14e72156291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:03.875203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:03.952599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915dcf-5c72-4e43-9683-a14e72156291 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:04.026966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:04.027579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:04.027859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:04.028154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:04.030501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:04.114481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:04.150299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:04.151767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bcd56d-a19b-4396-98db-208e5a915576 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:04.173142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 662/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:07.052726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84dcc-0854-42e6-9fea-d4e3e324ec51 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:07.053287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84dcc-0854-42e6-9fea-d4e3e324ec51 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:07.053287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b84dcc-0854-42e6-9fea-d4e3e324ec51 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:07.054597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 670/1332] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:07.059946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649eb38-8252-4b33-a185-8f706ca27e00 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:07.060905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649eb38-8252-4b33-a185-8f706ca27e00 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:07.061108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649eb38-8252-4b33-a185-8f706ca27e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:07.126021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f649eb38-8252-4b33-a185-8f706ca27e00 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:07.127291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f649eb38-8252-4b33-a185-8f706ca27e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:07.222578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 663/1333] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:07.511848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84dcc-0854-42e6-9fea-d4e3e324ec51 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:07.513693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-59b84dcc-0854-42e6-9fea-d4e3e324ec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:07.582605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:07.616977 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b84dcc-0854-42e6-9fea-d4e3e324ec51 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:07.690806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:07.691415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:07.691690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:07.691963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:07.693580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:07.801533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:07.802878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1443e-0359-4c55-934a-5e673efdf171 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:07.813010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:07.821070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 671/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:10.014327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac509-bbf9-43f4-a743-8ee449e17150 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:10.014848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac509-bbf9-43f4-a743-8ee449e17150 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:10.014848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fac509-bbf9-43f4-a743-8ee449e17150 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:10.016164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 664/1335] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:10.021525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f844882-e1cc-45d6-95b5-1150e5c74ad1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:10.021975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f844882-e1cc-45d6-95b5-1150e5c74ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:10.022079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f844882-e1cc-45d6-95b5-1150e5c74ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:10.087310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3f844882-e1cc-45d6-95b5-1150e5c74ad1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:10.092192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3f844882-e1cc-45d6-95b5-1150e5c74ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:10.182003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 672/1336] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:10.469775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fac509-bbf9-43f4-a743-8ee449e17150 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:10.471297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f4fac509-bbf9-43f4-a743-8ee449e17150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:10.510807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:10.575709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fac509-bbf9-43f4-a743-8ee449e17150 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:10.652660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:10.653261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:10.653539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:10.653947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:10.656056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:10.741253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:10.768298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:10.769742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da4212-c828-4dee-b0b9-d6eac6c6a771 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:10.789200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 665/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:13.651256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cea8e5-9e9f-4dc9-b76f-0da1e845ed9a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:13.651778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cea8e5-9e9f-4dc9-b76f-0da1e845ed9a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:13.651778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cea8e5-9e9f-4dc9-b76f-0da1e845ed9a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:13.653177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 673/1338] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:13.659085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86636-b8c6-472d-8231-8a2995c21bdc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:13.659503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86636-b8c6-472d-8231-8a2995c21bdc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:13.659612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b86636-b8c6-472d-8231-8a2995c21bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:13.724306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d4b86636-b8c6-472d-8231-8a2995c21bdc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:13.725508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d4b86636-b8c6-472d-8231-8a2995c21bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:13.818866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 666/1339] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:14.102224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cea8e5-9e9f-4dc9-b76f-0da1e845ed9a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:14.103739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-66cea8e5-9e9f-4dc9-b76f-0da1e845ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:14.179739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:14.211925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cea8e5-9e9f-4dc9-b76f-0da1e845ed9a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:14.293100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:14.293703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:14.293982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:14.294252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:14.295846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:14.404135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:14.405556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc7993-804c-4cff-8b2a-6b6a47683a58 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:14.424017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 674/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:18.868399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468b10b-c950-4441-9d45-3f61b4936e33 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:18.869020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468b10b-c950-4441-9d45-3f61b4936e33 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:18.869020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468b10b-c950-4441-9d45-3f61b4936e33 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:18.870311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 667/1341] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:18.875745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7885dc-6d74-483a-8873-704bc48c665f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:18.876180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7885dc-6d74-483a-8873-704bc48c665f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:18.876316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7885dc-6d74-483a-8873-704bc48c665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:18.881813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:18.945231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5d7885dc-6d74-483a-8873-704bc48c665f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:18.946495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5d7885dc-6d74-483a-8873-704bc48c665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:19.046284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 675/1342] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:19.334782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468b10b-c950-4441-9d45-3f61b4936e33 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:19.336367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e468b10b-c950-4441-9d45-3f61b4936e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:19.386103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:19.442281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468b10b-c950-4441-9d45-3f61b4936e33 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:19.517542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:19.518143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:19.518416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:19.518683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:19.520323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:19.616957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:19.634533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:19.635993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0490d2-ff20-4122-8ca3-1ed54d67ef7f service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:19.656706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 668/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:22.956622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f42e-aee5-40d0-88a0-b86820b9473a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:22.957144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f42e-aee5-40d0-88a0-b86820b9473a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:22.957144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542f42e-aee5-40d0-88a0-b86820b9473a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:22.958643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 676/1344] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:22.963990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ca0d-81c3-4eda-809d-abb131895d16 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:22.964475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ca0d-81c3-4eda-809d-abb131895d16 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:22.964569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ca0d-81c3-4eda-809d-abb131895d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:23.033075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-87e4ca0d-81c3-4eda-809d-abb131895d16 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:23.034273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-87e4ca0d-81c3-4eda-809d-abb131895d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:23.135218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 669/1345] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:23.419422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f42e-aee5-40d0-88a0-b86820b9473a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:23.421459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8542f42e-aee5-40d0-88a0-b86820b9473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:23.511616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:23.530647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542f42e-aee5-40d0-88a0-b86820b9473a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:23.620545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:23.621134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:23.621514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:23.621679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:23.624277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:23.749647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:23.751077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132a1d0-4b40-4274-a8c9-cc2e5e27d436 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:23.770726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 677/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:28.128670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096964c-0e86-4b73-9e44-2d0d5db6bb1a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.129258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096964c-0e86-4b73-9e44-2d0d5db6bb1a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.129258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096964c-0e86-4b73-9e44-2d0d5db6bb1a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.130717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 670/1347] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:28.135908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12134a3f-1dac-455a-b360-8d3ef9cceb78 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.136405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12134a3f-1dac-455a-b360-8d3ef9cceb78 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.136496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12134a3f-1dac-455a-b360-8d3ef9cceb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.153123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:28.208423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-12134a3f-1dac-455a-b360-8d3ef9cceb78 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:28.209670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-12134a3f-1dac-455a-b360-8d3ef9cceb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.315876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 678/1348] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:28.603389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096964c-0e86-4b73-9e44-2d0d5db6bb1a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:28.604965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b096964c-0e86-4b73-9e44-2d0d5db6bb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:28.662950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:28.708903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096964c-0e86-4b73-9e44-2d0d5db6bb1a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:28.784322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:28.784839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:28.785115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:28.785383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:28.786979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:29.017990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:29.021574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:29.023012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482935d-068c-4503-8114-abbaf4ef2d74 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:29.042600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 671/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:33.945648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f708b-0c54-4b45-aba8-5238bd26188f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:33.946143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f708b-0c54-4b45-aba8-5238bd26188f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:33.946243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f708b-0c54-4b45-aba8-5238bd26188f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:33.947539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 679/1350] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:33.953238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2183c-3761-4b97-b861-224170a79d2f None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:33.953644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2183c-3761-4b97-b861-224170a79d2f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:33.953810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2183c-3761-4b97-b861-224170a79d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:34.051516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1dc2183c-3761-4b97-b861-224170a79d2f None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:34.053165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1dc2183c-3761-4b97-b861-224170a79d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:34.211611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 672/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:38.313402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=59 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:38.536814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014172-9fd1-4d7f-bc93-c15ae97e590f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:38.537389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014172-9fd1-4d7f-bc93-c15ae97e590f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:38.537821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014172-9fd1-4d7f-bc93-c15ae97e590f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:38.539180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 680/1352] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:38.546401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8443-93bd-4223-9a7e-cc14e4adb36e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:38.546896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8443-93bd-4223-9a7e-cc14e4adb36e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:38.547138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8443-93bd-4223-9a7e-cc14e4adb36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:38.604831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:38.627433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e82b8443-93bd-4223-9a7e-cc14e4adb36e None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:38.628711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e82b8443-93bd-4223-9a7e-cc14e4adb36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:38.749127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 673/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:40.124100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3539d-fd7f-4877-b716-92c48b1a058f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:40.124637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3539d-fd7f-4877-b716-92c48b1a058f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:40.124637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3539d-fd7f-4877-b716-92c48b1a058f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:40.125993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 681/1354] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:40.131316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22692-57c3-4cb1-888f-97242b8aaeb0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:40.131741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22692-57c3-4cb1-888f-97242b8aaeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:40.131974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d22692-57c3-4cb1-888f-97242b8aaeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:40.208726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-75d22692-57c3-4cb1-888f-97242b8aaeb0 None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:40.209949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-75d22692-57c3-4cb1-888f-97242b8aaeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:40.252145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:40.316288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 674/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:43.847335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95dc4a-69c4-4f28-b926-a7aacf579495 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:43.848303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95dc4a-69c4-4f28-b926-a7aacf579495 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:43.848784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95dc4a-69c4-4f28-b926-a7aacf579495 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:43.854308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 682/1356] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:43.856377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a0fa-e774-4645-a85b-6e10685d3b3e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:43.857720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a0fa-e774-4645-a85b-6e10685d3b3e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:43.858222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a0fa-e774-4645-a85b-6e10685d3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:43.940020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1217a0fa-e774-4645-a85b-6e10685d3b3e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:43.941183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1217a0fa-e774-4645-a85b-6e10685d3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:44.052130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 675/1357] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:44.363500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524999-b1a8-477f-850f-0ba6827013f2 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:44.364681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524999-b1a8-477f-850f-0ba6827013f2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:44.365608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27524999-b1a8-477f-850f-0ba6827013f2 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:44.373237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 683/1358] 10.222.0.57 () {54 vars in 962 bytes} [Wed Sep 7 13:11:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:44.376173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836653a1-cf6d-4e7e-8c7c-d345d11729ab None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:44.376513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836653a1-cf6d-4e7e-8c7c-d345d11729ab None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:44.376819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836653a1-cf6d-4e7e-8c7c-d345d11729ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:44.401058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:44.470114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-836653a1-cf6d-4e7e-8c7c-d345d11729ab None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:44.471280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-836653a1-cf6d-4e7e-8c7c-d345d11729ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:44.600227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 676/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Sep 7 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:44.602320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524999-b1a8-477f-850f-0ba6827013f2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:44.604254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-27524999-b1a8-477f-850f-0ba6827013f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:44.770423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27524999-b1a8-477f-850f-0ba6827013f2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:44.851847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:44.892322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:44.892929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:44.893203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:44.893467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:44.895049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:44.994352 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:44.996643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ccf42-53ba-4de0-bd8b-27aea559b982 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:45.019871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 684/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:11:47.419051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ae72-390c-4237-9819-8cfd7ba35d2c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.420139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ae72-390c-4237-9819-8cfd7ba35d2c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.420837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ae72-390c-4237-9819-8cfd7ba35d2c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.422397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 677/1361] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:47.427813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7dd6-ef87-4cfe-bd37-adb9b727f862 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:47.428298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7dd6-ef87-4cfe-bd37-adb9b727f862 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:47.428419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e7dd6-ef87-4cfe-bd37-adb9b727f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:47.500231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-359e7dd6-ef87-4cfe-bd37-adb9b727f862 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:47.501314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-359e7dd6-ef87-4cfe-bd37-adb9b727f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.543002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:47.609614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 685/1362] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:47.902523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ae72-390c-4237-9819-8cfd7ba35d2c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:47.904958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-40e1ae72-390c-4237-9819-8cfd7ba35d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:47.976784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:48.068816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ae72-390c-4237-9819-8cfd7ba35d2c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:48.211740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:48.212507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:48.212782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:48.213078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:48.214612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:48.239512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:48.312265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:48.313898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31066-84ab-4835-b3fa-20aabe55bed4 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:48.331850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 678/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:51.034530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864eaaf-82a9-41bf-8019-9d8d7522679f None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.035586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864eaaf-82a9-41bf-8019-9d8d7522679f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.035956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864eaaf-82a9-41bf-8019-9d8d7522679f None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.037716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 686/1364] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:51.043107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16388432-3d96-40ba-8e4b-dd1d3b2ea093 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.043535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16388432-3d96-40ba-8e4b-dd1d3b2ea093 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.043789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16388432-3d96-40ba-8e4b-dd1d3b2ea093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.118283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-16388432-3d96-40ba-8e4b-dd1d3b2ea093 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:51.119495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-16388432-3d96-40ba-8e4b-dd1d3b2ea093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.222437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:51.225374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 679/1365] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:51.528431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736c4e-2435-4837-aa75-1a214a3f999b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.529532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736c4e-2435-4837-aa75-1a214a3f999b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.530030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73736c4e-2435-4837-aa75-1a214a3f999b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.531481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 687/1366] 10.222.0.57 () {54 vars in 962 bytes} [Wed Sep 7 13:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:51.536975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ae41-58cb-4bd4-b0bd-d6ccd4c01b74 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:51.537263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ae41-58cb-4bd4-b0bd-d6ccd4c01b74 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:51.541732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2ae41-58cb-4bd4-b0bd-d6ccd4c01b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:51.619396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0dd2ae41-58cb-4bd4-b0bd-d6ccd4c01b74 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:51.620632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0dd2ae41-58cb-4bd4-b0bd-d6ccd4c01b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.752889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 680/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Sep 7 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:51.761579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73736c4e-2435-4837-aa75-1a214a3f999b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:51.763105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-73736c4e-2435-4837-aa75-1a214a3f999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:51.924389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73736c4e-2435-4837-aa75-1a214a3f999b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:51.947220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.056792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:52.057559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.057934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.058299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.060032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:52.123760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d0f8-c55d-450b-9154-7971b716e896 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.124376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d0f8-c55d-450b-9154-7971b716e896 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.124376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d0f8-c55d-450b-9154-7971b716e896 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.125815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 681/1368] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:52.130585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55743e6f-fa21-4395-977f-7468daa848e5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.130864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55743e6f-fa21-4395-977f-7468daa848e5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.131136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55743e6f-fa21-4395-977f-7468daa848e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.159871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:52.161029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00014a25-60ff-44f3-9179-1d7db4c0cf08 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:52.181987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 688/1369] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:52.196492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.205991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-55743e6f-fa21-4395-977f-7468daa848e5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:52.207443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-55743e6f-fa21-4395-977f-7468daa848e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:52.316642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 682/1370] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:11:52.657697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bd4c1-5617-40df-afdf-be508acc1cc6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.657986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bd4c1-5617-40df-afdf-be508acc1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.658258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bd4c1-5617-40df-afdf-be508acc1cc6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.659764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 689/1371] 10.222.0.57 () {54 vars in 964 bytes} [Wed Sep 7 13:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:52.668003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d258cd-8e9b-4ab0-ace1-966a67bc5ff4 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:52.668333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d258cd-8e9b-4ab0-ace1-966a67bc5ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:52.668604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d258cd-8e9b-4ab0-ace1-966a67bc5ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:52.748718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b0d258cd-8e9b-4ab0-ace1-966a67bc5ff4 None None] MFA Rules not processed for user `6b143093bf1e4625a24a2e26ce5ba8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:52.749836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b0d258cd-8e9b-4ab0-ace1-966a67bc5ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:52.826922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.835367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 683/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Wed Sep 7 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:52.845748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bd4c1-5617-40df-afdf-be508acc1cc6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:52.845748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-747bd4c1-5617-40df-afdf-be508acc1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:52.877341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:52.959185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bd4c1-5617-40df-afdf-be508acc1cc6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:53.042750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:53.043368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:53.043643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:53.043910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:53.045633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:53.126747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:53.162548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:53.164065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f042b9-5947-4947-82fd-cb4049cb0296 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:53.190885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 690/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:54.605991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca90e-ff0f-4f96-a10c-9994e8766b1c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.606512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca90e-ff0f-4f96-a10c-9994e8766b1c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.606512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca90e-ff0f-4f96-a10c-9994e8766b1c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.608786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 684/1374] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:11:54.614114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7587-5d69-4157-a84d-1a6d9c4c3395 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:54.614579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7587-5d69-4157-a84d-1a6d9c4c3395 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:54.614694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d7587-5d69-4157-a84d-1a6d9c4c3395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:54.691581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5a4d7587-5d69-4157-a84d-1a6d9c4c3395 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:54.693547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5a4d7587-5d69-4157-a84d-1a6d9c4c3395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:54.808953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 691/1375] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:55.134120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca90e-ff0f-4f96-a10c-9994e8766b1c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:55.134120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-37aca90e-ff0f-4f96-a10c-9994e8766b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:55.263897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca90e-ff0f-4f96-a10c-9994e8766b1c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:55.333715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:55.384104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:55.384719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:55.384992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:55.385256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:55.386879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:55.485183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:55.486505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e627c1-ee9b-4247-827a-1008d3066391 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:55.506097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 685/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:11:57.845660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae640b9-0818-4f38-b908-b3fdcdc4787c None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.846244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae640b9-0818-4f38-b908-b3fdcdc4787c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.846244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae640b9-0818-4f38-b908-b3fdcdc4787c None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.847711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 692/1377] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:11:57.852777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ca2e-8624-4591-b8a4-7b5bb1c16125 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:57.853191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ca2e-8624-4591-b8a4-7b5bb1c16125 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:57.853366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457ca2e-8624-4591-b8a4-7b5bb1c16125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:57.923064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1457ca2e-8624-4591-b8a4-7b5bb1c16125 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:11:57.924211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1457ca2e-8624-4591-b8a4-7b5bb1c16125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:57.955076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:58.027527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 686/1378] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:11:58.323079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae640b9-0818-4f38-b908-b3fdcdc4787c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:11:58.326208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cae640b9-0818-4f38-b908-b3fdcdc4787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:58.368859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:58.492967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae640b9-0818-4f38-b908-b3fdcdc4787c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:11:58.610599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:11:58.616387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88748a-6df0-4207-b672-133995551457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:11:58.617066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88748a-6df0-4207-b672-133995551457 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:11:58.617410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88748a-6df0-4207-b672-133995551457 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:11:58.617806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88748a-6df0-4207-b672-133995551457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:11:58.619603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cb88748a-6df0-4207-b672-133995551457 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:11:58.721585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88748a-6df0-4207-b672-133995551457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:11:58.724129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88748a-6df0-4207-b672-133995551457 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:11:58.744302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 693/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:01.060427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802c79-7f79-41e9-bf2a-4c09ee41c908 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.060861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802c79-7f79-41e9-bf2a-4c09ee41c908 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.061120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7802c79-7f79-41e9-bf2a-4c09ee41c908 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.062283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 687/1380] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:01.070100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f859013-89bf-465f-aeca-b8e9fc9ae051 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.070100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f859013-89bf-465f-aeca-b8e9fc9ae051 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.070100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f859013-89bf-465f-aeca-b8e9fc9ae051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.158545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5f859013-89bf-465f-aeca-b8e9fc9ae051 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:01.160138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5f859013-89bf-465f-aeca-b8e9fc9ae051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:01.226626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:01.258751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 694/1381] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:01.552621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802c79-7f79-41e9-bf2a-4c09ee41c908 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:01.554141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c7802c79-7f79-41e9-bf2a-4c09ee41c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:01.718677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7802c79-7f79-41e9-bf2a-4c09ee41c908 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:01.733058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:01.841794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:01.842327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:01.842601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:01.842995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:01.844797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:01.942034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:01.943591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b942b-92bf-4660-acdf-e4f98385806b service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:01.962315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 688/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:04.449072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505829-3d09-4d10-9cf7-97db0a7d8417 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:04.449770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505829-3d09-4d10-9cf7-97db0a7d8417 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:04.449770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505829-3d09-4d10-9cf7-97db0a7d8417 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:04.450975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 695/1383] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:04.457110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996193d-6a6b-4f5f-abe0-346de058b0ae None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:04.457589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996193d-6a6b-4f5f-abe0-346de058b0ae None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:04.458011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996193d-6a6b-4f5f-abe0-346de058b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:04.489052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:04.540826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7996193d-6a6b-4f5f-abe0-346de058b0ae None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:04.542459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7996193d-6a6b-4f5f-abe0-346de058b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:04.656718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 689/1384] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:04.964032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505829-3d09-4d10-9cf7-97db0a7d8417 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:04.965574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-22505829-3d09-4d10-9cf7-97db0a7d8417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:05.112893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505829-3d09-4d10-9cf7-97db0a7d8417 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:05.166482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:05.231254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:05.231720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:05.231990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:05.232285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:05.233881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:05.327953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:05.330077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c056c-cae7-4441-afd6-5db00ea3309d service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:05.349469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 696/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:12:07.495597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031839b-002a-4065-949b-b4cdaadc905c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:07.496171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031839b-002a-4065-949b-b4cdaadc905c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:07.496610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031839b-002a-4065-949b-b4cdaadc905c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:07.498357 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 690/1386] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:07.503743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91564e74-fa56-4cdd-a966-5ed5a5465096 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:07.504229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91564e74-fa56-4cdd-a966-5ed5a5465096 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:07.504324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91564e74-fa56-4cdd-a966-5ed5a5465096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:07.574240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-91564e74-fa56-4cdd-a966-5ed5a5465096 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:07.575458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-91564e74-fa56-4cdd-a966-5ed5a5465096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:07.584528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:07.674792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 697/1387] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:07.964223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031839b-002a-4065-949b-b4cdaadc905c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:07.965719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1031839b-002a-4065-949b-b4cdaadc905c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:08.055225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:08.110453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031839b-002a-4065-949b-b4cdaadc905c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:08.225707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:08.226248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:08.226504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:08.226770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:08.228446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:08.291692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:08.320735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:08.322487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cb9edb-dee9-4cb5-9424-a9d3e7706150 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:08.342131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 691/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:08.836292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9b2f-928f-4008-b277-fb17da35c752 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:08.836847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9b2f-928f-4008-b277-fb17da35c752 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:08.836847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9b2f-928f-4008-b277-fb17da35c752 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:08.838095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 698/1389] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:08.844173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff1767-0a81-4802-9872-4a5a29d0d4f6 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:08.844611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff1767-0a81-4802-9872-4a5a29d0d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:08.844716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff1767-0a81-4802-9872-4a5a29d0d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:08.913569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-eaff1767-0a81-4802-9872-4a5a29d0d4f6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:08.914836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-eaff1767-0a81-4802-9872-4a5a29d0d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.012976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 692/1390] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:09.321523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dec724-ee82-4e06-a6b7-3a41e252102a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.321827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dec724-ee82-4e06-a6b7-3a41e252102a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.322101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dec724-ee82-4e06-a6b7-3a41e252102a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.323458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 699/1391] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 7 13:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:09.328841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9479401-5ad1-40bc-a456-f2c39dce4403 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.329120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9479401-5ad1-40bc-a456-f2c39dce4403 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.329722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9479401-5ad1-40bc-a456-f2c39dce4403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.378084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:09.416134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f9479401-5ad1-40bc-a456-f2c39dce4403 None None] MFA Rules not processed for user `50d240642e9246dbad42f8e379a60b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:09.417406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f9479401-5ad1-40bc-a456-f2c39dce4403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.493052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 693/1392] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 7 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:09.502761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dec724-ee82-4e06-a6b7-3a41e252102a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:09.504335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f7dec724-ee82-4e06-a6b7-3a41e252102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.606574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dec724-ee82-4e06-a6b7-3a41e252102a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:09.644316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:09.680754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:09.681366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:09.681641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:09.681907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:09.683490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:09.792965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:09.794281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111044ab-ab57-48a4-b58a-490de432369a service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:09.814053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 700/1393] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:10.725647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c6f7-79f0-48b6-9dd6-1c69f054b04c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:10.726263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c6f7-79f0-48b6-9dd6-1c69f054b04c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:10.726263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c6f7-79f0-48b6-9dd6-1c69f054b04c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:10.727677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 694/1394] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:10.732895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:10.733301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:10.733434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:10.803983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:10.805306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:10.824703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:10.903004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 701/1395] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:11.129596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84bfd-6bf6-4567-908c-71e60b1d2db8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:11.129883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84bfd-6bf6-4567-908c-71e60b1d2db8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:11.130159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84bfd-6bf6-4567-908c-71e60b1d2db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:11.192661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:11.193892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:11.200681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dcb84bfd-6bf6-4567-908c-71e60b1d2db8 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:11.201868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dcb84bfd-6bf6-4567-908c-71e60b1d2db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:11.283573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:11.291695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 695/1396] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:11.310982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e69487-239e-4171-9f2b-bd92b28303ea None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:11.336438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19068e18-2e7d-4d4c-8a43-a7d8de4f81f4 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:11.336813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19068e18-2e7d-4d4c-8a43-a7d8de4f81f4 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:11.337096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19068e18-2e7d-4d4c-8a43-a7d8de4f81f4 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:11.338698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 696/1397] 10.222.0.57 () {54 vars in 943 bytes} [Wed Sep 7 13:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:12:11.344749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:11.345030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:11.345302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:11.352050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:11.431617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] MFA Rules not processed for user `0b772e6cbf5f4fecbc91fc058ff29dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:11.432786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:11.434960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:11.435577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:11.435870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:11.436158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:11.438260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:11.528034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:11.529652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0093e3-8409-49a9-a119-8ff7b28ab37e service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:11.540626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 697/1398] 10.222.0.57 () {58 vars in 1040 bytes} [Wed Sep 7 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:11.548136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 702/1399] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:12:11.550543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:11.560264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2d996-66b8-4dc9-8b66-fda443db654a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:11.608414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:11.666285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:11.666846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:11.667120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:11.667468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:11.669095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:11.753823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:11.755424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e35894-daf4-4dbf-93bf-b2bb802304be service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:11.763490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 698/1400] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:12:13.980502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54abd1-c952-4278-9020-ef02fef2d4ac None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:13.980502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54abd1-c952-4278-9020-ef02fef2d4ac None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:13.980502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54abd1-c952-4278-9020-ef02fef2d4ac None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:13.980502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 703/1401] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:13.981363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d601-58f6-4d01-a4ef-7d506fe6b78e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:13.981363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d601-58f6-4d01-a4ef-7d506fe6b78e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:13.981363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61d601-58f6-4d01-a4ef-7d506fe6b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:14.045676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-2b61d601-58f6-4d01-a4ef-7d506fe6b78e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:14.047449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2b61d601-58f6-4d01-a4ef-7d506fe6b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:14.079227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:14.160141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 699/1402] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:14.465642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54abd1-c952-4278-9020-ef02fef2d4ac None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:14.465642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ae54abd1-c952-4278-9020-ef02fef2d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:14.508780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:14.637410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54abd1-c952-4278-9020-ef02fef2d4ac None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:14.788290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:14.789108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:14.789614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:14.790051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:14.792054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:14.922799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:14.924615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d80a1-191c-489e-b041-58dc826c2095 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:14.945117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 704/1403] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:15.108907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:17.379511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d238f-9d82-401d-a716-0078b6b5ef2a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.380060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d238f-9d82-401d-a716-0078b6b5ef2a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.380060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d238f-9d82-401d-a716-0078b6b5ef2a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.381436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 700/1404] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:17.386773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813fa1f-9e33-479e-afc9-980875434399 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:17.387222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813fa1f-9e33-479e-afc9-980875434399 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:17.387325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813fa1f-9e33-479e-afc9-980875434399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:17.461537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a813fa1f-9e33-479e-afc9-980875434399 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:17.463005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a813fa1f-9e33-479e-afc9-980875434399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:17.545124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:17.570749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 705/1405] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:17.866302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d238f-9d82-401d-a716-0078b6b5ef2a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:17.867879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-313d238f-9d82-401d-a716-0078b6b5ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:18.030358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d238f-9d82-401d-a716-0078b6b5ef2a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:18.047985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:18.163988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:18.164636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:18.164895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:18.165171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:18.166781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:18.265841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:18.267553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e293e9c-90df-495e-acdb-e16101dc4dc2 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:18.287990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 701/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:20.732495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d312bb-c68d-41f4-90fc-50bb1fe10f38 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.733432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d312bb-c68d-41f4-90fc-50bb1fe10f38 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.733805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d312bb-c68d-41f4-90fc-50bb1fe10f38 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.735291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 706/1407] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:20.740662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf70eff-1f7e-44b9-839e-1578c59bd584 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:20.741065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf70eff-1f7e-44b9-839e-1578c59bd584 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:20.741281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf70eff-1f7e-44b9-839e-1578c59bd584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:20.764517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:20.817839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ddf70eff-1f7e-44b9-839e-1578c59bd584 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:20.819271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ddf70eff-1f7e-44b9-839e-1578c59bd584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:20.933021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 702/1408] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:21.229239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d312bb-c68d-41f4-90fc-50bb1fe10f38 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:21.231134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-58d312bb-c68d-41f4-90fc-50bb1fe10f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.396466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d312bb-c68d-41f4-90fc-50bb1fe10f38 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:21.461854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:21.520978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:21.521507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:21.521781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:21.525969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:21.526319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:21.628241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:21.630245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dc6c6-815c-4064-aac2-22e4b1a8a24d service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:21.653450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 707/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:30.930803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=57 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:31.650873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=71 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:36.488997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786b527-2fda-4ba8-93c0-6a70adf3ee8e None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:36.489544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786b527-2fda-4ba8-93c0-6a70adf3ee8e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:36.489544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786b527-2fda-4ba8-93c0-6a70adf3ee8e None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:36.491055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 703/1410] 10.222.0.57 () {54 vars in 918 bytes} [Wed Sep 7 13:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:36.496190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfee3d-3a65-40d8-872c-981eebbafcbd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:36.496628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfee3d-3a65-40d8-872c-981eebbafcbd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:36.500316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfee3d-3a65-40d8-872c-981eebbafcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:36.579401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-81cfee3d-3a65-40d8-872c-981eebbafcbd None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:36.580629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-81cfee3d-3a65-40d8-872c-981eebbafcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:36.685475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 708/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Sep 7 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:36.700152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466136e-30e8-44ca-8ecc-4d48edb8170a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:36.700439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466136e-30e8-44ca-8ecc-4d48edb8170a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:36.700711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466136e-30e8-44ca-8ecc-4d48edb8170a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:36.702059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 704/1412] 10.222.0.57 () {54 vars in 918 bytes} [Wed Sep 7 13:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:36.707613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8ed2-0cbf-4ef8-9712-6a96e1bcafd1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:36.707895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8ed2-0cbf-4ef8-9712-6a96e1bcafd1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:36.708198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a8ed2-0cbf-4ef8-9712-6a96e1bcafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:36.781908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:36.784554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c87a8ed2-0cbf-4ef8-9712-6a96e1bcafd1 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:36.791663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c87a8ed2-0cbf-4ef8-9712-6a96e1bcafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:36.902078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 709/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Sep 7 13:12:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:12:39.497161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d45bb-83ee-4086-a83a-7baf0a5eaa0c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:39.497708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d45bb-83ee-4086-a83a-7baf0a5eaa0c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:39.497708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d45bb-83ee-4086-a83a-7baf0a5eaa0c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:39.499049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:39.505166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5329f6-ebbc-40aa-a984-5ea18d5b6d89 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:39.505682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5329f6-ebbc-40aa-a984-5ea18d5b6d89 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:39.505780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5329f6-ebbc-40aa-a984-5ea18d5b6d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:39.571446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5a5329f6-ebbc-40aa-a984-5ea18d5b6d89 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:39.572655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5a5329f6-ebbc-40aa-a984-5ea18d5b6d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:39.628116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:39.670580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:39.966933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d45bb-83ee-4086-a83a-7baf0a5eaa0c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:39.968521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ac9d45bb-83ee-4086-a83a-7baf0a5eaa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:40.116561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d45bb-83ee-4086-a83a-7baf0a5eaa0c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:40.189758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:40.229232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:40.229831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:40.230113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:40.230384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:40.231978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:40.320761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:40.322398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f58aa-e520-44ad-97ab-ee7d89156bf8 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:40.339958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 706/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:41.490390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240dc9-b115-4782-bb23-c41d21549941 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:41.490958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240dc9-b115-4782-bb23-c41d21549941 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:41.491076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac240dc9-b115-4782-bb23-c41d21549941 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:41.492409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:41.498833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c0ec-c3a5-4546-a008-5c7548f70cc0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:41.499239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c0ec-c3a5-4546-a008-5c7548f70cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:41.499410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246c0ec-c3a5-4546-a008-5c7548f70cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:41.574881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8246c0ec-c3a5-4546-a008-5c7548f70cc0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:41.576121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8246c0ec-c3a5-4546-a008-5c7548f70cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:41.603640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:41.676841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:41.828688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240dc9-b115-4782-bb23-c41d21549941 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:41.830214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ac240dc9-b115-4782-bb23-c41d21549941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:41.981140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac240dc9-b115-4782-bb23-c41d21549941 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:42.022380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:42.095316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:42.095916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:42.096209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:42.096471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:42.098038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:42.186688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:42.188956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916b0b9-07a7-4ed1-ad21-a42d83708910 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:42.206414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 712/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:12:43.356595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c380-8ada-435e-adff-b70f7ac74e7a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:43.357159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c380-8ada-435e-adff-b70f7ac74e7a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:43.357159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52c380-8ada-435e-adff-b70f7ac74e7a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:43.358662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:43.365921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62def14-dc97-4599-906c-116c9ce0daf8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:43.373262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62def14-dc97-4599-906c-116c9ce0daf8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:43.373262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62def14-dc97-4599-906c-116c9ce0daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:43.425140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:43.449047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e62def14-dc97-4599-906c-116c9ce0daf8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:43.450373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e62def14-dc97-4599-906c-116c9ce0daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:43.550633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:43.706027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c380-8ada-435e-adff-b70f7ac74e7a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:43.707719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8e52c380-8ada-435e-adff-b70f7ac74e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:43.854721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52c380-8ada-435e-adff-b70f7ac74e7a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:43.867519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:43.969621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:43.970138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:43.970412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:43.970676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:43.972342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:44.060646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:44.062244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ee692-397b-48c5-904c-f91f62c7acb4 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:44.079739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 709/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:45.191151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb02d2-0318-462c-88d8-b17c4137e598 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:45.191712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb02d2-0318-462c-88d8-b17c4137e598 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:45.191712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb02d2-0318-462c-88d8-b17c4137e598 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:45.193110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:45.199489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ab7a-2e9f-4a18-bfc6-dfc50e2763cc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:45.199942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ab7a-2e9f-4a18-bfc6-dfc50e2763cc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:45.200055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68ab7a-2e9f-4a18-bfc6-dfc50e2763cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:45.221259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:45.277108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-2c68ab7a-2e9f-4a18-bfc6-dfc50e2763cc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:45.278243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2c68ab7a-2e9f-4a18-bfc6-dfc50e2763cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:45.384835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:45.535873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb02d2-0318-462c-88d8-b17c4137e598 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:45.537332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aceb02d2-0318-462c-88d8-b17c4137e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:45.647367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:45.684774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb02d2-0318-462c-88d8-b17c4137e598 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:45.799078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:45.799622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:45.799893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:45.800187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:45.801766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:45.884800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:45.898039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:45.899635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c83e5a-6aef-44f3-bd34-ca59e7eef7f4 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:45.917842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 715/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:47.066310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576b78-83d2-4a51-a75a-d8c6aaf5f599 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:47.066897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576b78-83d2-4a51-a75a-d8c6aaf5f599 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:47.066897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d576b78-83d2-4a51-a75a-d8c6aaf5f599 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:47.068260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:47.074430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cea92-d329-4a51-a6f8-9da7c820117e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:47.074889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cea92-d329-4a51-a6f8-9da7c820117e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:47.075002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cea92-d329-4a51-a6f8-9da7c820117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:47.150275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f68cea92-d329-4a51-a6f8-9da7c820117e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:47.151823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f68cea92-d329-4a51-a6f8-9da7c820117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:47.247259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:47.398068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d576b78-83d2-4a51-a75a-d8c6aaf5f599 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:47.399601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5d576b78-83d2-4a51-a75a-d8c6aaf5f599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:47.485338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:47.545759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d576b78-83d2-4a51-a75a-d8c6aaf5f599 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:47.658322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:47.658927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:47.659203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:47.659473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:47.661122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:47.709991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:47.754762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:47.756886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc6d5c-3f90-4f9b-b546-f0e1fbc9828e service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:47.775607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 712/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:48.920782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca37e6-d2fa-4158-a614-220db7d74aa5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:48.921314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca37e6-d2fa-4158-a614-220db7d74aa5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:48.921314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca37e6-d2fa-4158-a614-220db7d74aa5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:48.922606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:48.928805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c682e-ef92-48ce-9e20-276ba3d24094 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:48.929275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c682e-ef92-48ce-9e20-276ba3d24094 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:48.929389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c682e-ef92-48ce-9e20-276ba3d24094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:49.005974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-383c682e-ef92-48ce-9e20-276ba3d24094 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:49.007198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-383c682e-ef92-48ce-9e20-276ba3d24094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:49.109615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:49.259266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca37e6-d2fa-4158-a614-220db7d74aa5 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:49.260700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3bca37e6-d2fa-4158-a614-220db7d74aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:49.310216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:49.406759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca37e6-d2fa-4158-a614-220db7d74aa5 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:49.520238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:49.520697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:49.520970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:49.521241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:49.522830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:49.530105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:49.613482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:49.615052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cdf87b-3d6c-4657-a663-afd3ed39b228 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:49.633736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 718/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:50.774861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd2ab-7bc8-4a16-80fb-bc1b3114abcd None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:50.774861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd2ab-7bc8-4a16-80fb-bc1b3114abcd None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:50.774861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebd2ab-7bc8-4a16-80fb-bc1b3114abcd None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:50.774861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:50.783360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c535e-f627-4892-a725-ffbbe4611a8a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:50.783825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c535e-f627-4892-a725-ffbbe4611a8a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:50.783936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c535e-f627-4892-a725-ffbbe4611a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:50.858616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a52c535e-f627-4892-a725-ffbbe4611a8a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:50.859992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a52c535e-f627-4892-a725-ffbbe4611a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:50.925928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:50.954747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:51.107556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd2ab-7bc8-4a16-80fb-bc1b3114abcd None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:51.109767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b7ebd2ab-7bc8-4a16-80fb-bc1b3114abcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:51.127907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:51.255582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebd2ab-7bc8-4a16-80fb-bc1b3114abcd None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:51.341169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:51.366685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:51.367285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:51.367557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:51.367820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:51.369434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:51.460677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:51.462271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8da3d-57ba-42ca-9bc6-3edb5345a87a service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:51.479975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 715/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:52.676039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced5168-5817-42ec-af83-bae1fcbaf421 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:52.676549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced5168-5817-42ec-af83-bae1fcbaf421 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:52.676656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced5168-5817-42ec-af83-bae1fcbaf421 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:52.678008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:52.684253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e2ca3-5a21-42cf-99c4-73d687f3f6a8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:52.684657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e2ca3-5a21-42cf-99c4-73d687f3f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:52.684791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e2ca3-5a21-42cf-99c4-73d687f3f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:52.760988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5d2e2ca3-5a21-42cf-99c4-73d687f3f6a8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:52.762200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5d2e2ca3-5a21-42cf-99c4-73d687f3f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:52.803444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:52.858195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:53.009773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced5168-5817-42ec-af83-bae1fcbaf421 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:53.011273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9ced5168-5817-42ec-af83-bae1fcbaf421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:53.157413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced5168-5817-42ec-af83-bae1fcbaf421 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:53.211247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:53.269438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:53.269967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:53.270240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:53.270506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:53.272114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:53.360984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:53.362571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845eb4d5-9bfe-4ec7-b97c-b4259af8bbf1 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:53.380807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 721/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:54.495130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774b89c-b9c0-4594-ba9e-e0ce4b655f2d None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:54.495696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774b89c-b9c0-4594-ba9e-e0ce4b655f2d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:54.495696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774b89c-b9c0-4594-ba9e-e0ce4b655f2d None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:54.497087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:54.503847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244a84b-6715-4b74-9bf8-c57739889cc8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:54.504298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244a84b-6715-4b74-9bf8-c57739889cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:54.504405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244a84b-6715-4b74-9bf8-c57739889cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:54.580799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c244a84b-6715-4b74-9bf8-c57739889cc8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:54.582006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c244a84b-6715-4b74-9bf8-c57739889cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:54.584021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:54.680820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:54.835153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774b89c-b9c0-4594-ba9e-e0ce4b655f2d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:54.836711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e774b89c-b9c0-4594-ba9e-e0ce4b655f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:54.988781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774b89c-b9c0-4594-ba9e-e0ce4b655f2d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:55.016816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:55.102249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:55.102852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:55.103128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:55.103394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:55.105028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:55.193839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:55.195428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b59e5-f615-49fd-bf85-dab99d4949e8 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:55.213194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 718/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:12:57.290608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045d32-c44a-4531-835b-04003c506fb8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:57.291161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045d32-c44a-4531-835b-04003c506fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:57.291161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045d32-c44a-4531-835b-04003c506fb8 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:57.292500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:12:57.298483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b57730-91f4-4c2c-ae2a-ee65878387cd None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:57.298936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b57730-91f4-4c2c-ae2a-ee65878387cd None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:57.299032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b57730-91f4-4c2c-ae2a-ee65878387cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:57.339598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:57.364540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b1b57730-91f4-4c2c-ae2a-ee65878387cd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:12:57.365759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b1b57730-91f4-4c2c-ae2a-ee65878387cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:57.464042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:12:57.746647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045d32-c44a-4531-835b-04003c506fb8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:12:57.748232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-21045d32-c44a-4531-835b-04003c506fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:57.851064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045d32-c44a-4531-835b-04003c506fb8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:12:57.882568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:12:57.924114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:12:57.924660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:12:57.924933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:12:57.925198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:12:57.926806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:12:58.033137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:12:58.034565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d29031-b64f-4a0b-b541-fca96f9e5cd9 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:12:58.052518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 724/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:00.360979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9cbe-c8b9-4c8d-bf93-578b3f699acc None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.361555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9cbe-c8b9-4c8d-bf93-578b3f699acc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.361555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb9cbe-c8b9-4c8d-bf93-578b3f699acc None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.362854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:00.368139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d94b-883a-4246-8d72-beaf07634669 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:00.368548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d94b-883a-4246-8d72-beaf07634669 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:00.368684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d94b-883a-4246-8d72-beaf07634669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:00.434261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-22e0d94b-883a-4246-8d72-beaf07634669 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:00.435474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-22e0d94b-883a-4246-8d72-beaf07634669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:00.448476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:00.536427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:00.829802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9cbe-c8b9-4c8d-bf93-578b3f699acc None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:00.831335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e9eb9cbe-c8b9-4c8d-bf93-578b3f699acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:00.937739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb9cbe-c8b9-4c8d-bf93-578b3f699acc None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:00.950351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:01.012527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:01.013128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:01.013401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:01.013666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:01.015247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:01.122058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:01.123483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a6829b-f8b4-49f8-a837-2e40cf0c1834 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:01.142334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 721/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:13:03.678948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2026-02d2-44aa-8c2c-91fbc5895377 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:03.679448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2026-02d2-44aa-8c2c-91fbc5895377 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:03.679543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c2026-02d2-44aa-8c2c-91fbc5895377 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:03.681005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:03.686610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9df7a-0e68-49fa-b72a-2e2c998bbb83 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:03.687043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9df7a-0e68-49fa-b72a-2e2c998bbb83 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:03.687199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9df7a-0e68-49fa-b72a-2e2c998bbb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:03.736972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:03.755334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dbf9df7a-0e68-49fa-b72a-2e2c998bbb83 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:03.756620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dbf9df7a-0e68-49fa-b72a-2e2c998bbb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:03.855816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:04.143484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2026-02d2-44aa-8c2c-91fbc5895377 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:04.145033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-528c2026-02d2-44aa-8c2c-91fbc5895377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.247831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c2026-02d2-44aa-8c2c-91fbc5895377 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:04.288975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:04.321457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:04.322059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:04.322329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:04.322615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:04.324237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:04.433116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:04.434459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4f2cd-7332-4654-bb9b-7f3b8378af07 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:04.452890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 727/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:06.845828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364045-2686-4545-914a-72b303e9ec18 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.846361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364045-2686-4545-914a-72b303e9ec18 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.846361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05364045-2686-4545-914a-72b303e9ec18 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.847721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:06.853245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39ba7-707e-4f5d-8886-8d263c71d967 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:06.853637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39ba7-707e-4f5d-8886-8d263c71d967 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:06.853783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39ba7-707e-4f5d-8886-8d263c71d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:06.919789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9ca39ba7-707e-4f5d-8886-8d263c71d967 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:06.920958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9ca39ba7-707e-4f5d-8886-8d263c71d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:06.941407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:07.016516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:07.301387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364045-2686-4545-914a-72b303e9ec18 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:07.302974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-05364045-2686-4545-914a-72b303e9ec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:07.404862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05364045-2686-4545-914a-72b303e9ec18 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:07.425540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:07.479046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:07.479642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:07.479913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:07.480209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:07.481781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:07.588887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:07.590240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d4cf2-0401-4254-a4a5-b9b467f4c857 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:07.608333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 724/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:09.826976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095b721-3079-454b-9ca1-d0e6de351d17 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:09.827560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095b721-3079-454b-9ca1-d0e6de351d17 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:09.827560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095b721-3079-454b-9ca1-d0e6de351d17 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:09.828934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:09.834246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2278e-9d82-4a5c-952d-d08965676cc5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:09.834672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2278e-9d82-4a5c-952d-d08965676cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:09.834845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2278e-9d82-4a5c-952d-d08965676cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:09.900859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:09.904040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-27f2278e-9d82-4a5c-952d-d08965676cc5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:09.905301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-27f2278e-9d82-4a5c-952d-d08965676cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:10.003475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:10.292387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095b721-3079-454b-9ca1-d0e6de351d17 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:10.293952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c095b721-3079-454b-9ca1-d0e6de351d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:10.403323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095b721-3079-454b-9ca1-d0e6de351d17 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:10.455325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:10.478742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:10.479361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:10.479635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:10.479909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:10.481528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:10.589873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:10.591220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886f01-df1a-4af7-87b9-419a33a2af56 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:10.610468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 730/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:12.818356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8ed48-4a94-4ed9-a61e-695f307292be None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:12.818933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8ed48-4a94-4ed9-a61e-695f307292be None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:12.818933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8ed48-4a94-4ed9-a61e-695f307292be None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:12.820323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:12.825694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4b16-87ba-49b0-abc4-513bc22fdaa5 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:12.826142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4b16-87ba-49b0-abc4-513bc22fdaa5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:12.826241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a4b16-87ba-49b0-abc4-513bc22fdaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:12.892131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-487a4b16-87ba-49b0-abc4-513bc22fdaa5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:12.893349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-487a4b16-87ba-49b0-abc4-513bc22fdaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:12.922914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:12.989756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:13.275207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8ed48-4a94-4ed9-a61e-695f307292be None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:13.277033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3fd8ed48-4a94-4ed9-a61e-695f307292be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:13.386536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8ed48-4a94-4ed9-a61e-695f307292be None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:13.415194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:13.461758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:13.462462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:13.462852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:13.463213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:13.465183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:13.574311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:13.575794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba831d-6cb0-40c6-83e0-17377988776e service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:13.595091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 727/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:15.906283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae019-23ca-4504-9bd8-19395cb290f5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.906830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae019-23ca-4504-9bd8-19395cb290f5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.906830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae019-23ca-4504-9bd8-19395cb290f5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.908249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:15.913687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b624ff-6199-4b4e-b526-719eebaf9ed8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:15.919061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b624ff-6199-4b4e-b526-719eebaf9ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:15.919061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b624ff-6199-4b4e-b526-719eebaf9ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:15.980974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d6b624ff-6199-4b4e-b526-719eebaf9ed8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:15.982176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d6b624ff-6199-4b4e-b526-719eebaf9ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:15.990935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:16.083755 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:16.370758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae019-23ca-4504-9bd8-19395cb290f5 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:16.372328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e9fae019-23ca-4504-9bd8-19395cb290f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.478128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae019-23ca-4504-9bd8-19395cb290f5 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:16.534155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:16.552464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:16.553163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:16.553450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:16.553715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:16.555315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:16.669709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:16.671144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1015e5-87e1-4575-9f44-624cb7c531c6 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:16.689228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 733/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:18.899692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54446d14-55c1-406b-a41b-ac8158614a9d None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.900308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54446d14-55c1-406b-a41b-ac8158614a9d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.900308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54446d14-55c1-406b-a41b-ac8158614a9d None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.901878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:18.907652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b542-1e70-4f1d-81dd-bc80198c9acd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:18.908164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b542-1e70-4f1d-81dd-bc80198c9acd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:18.908271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17b542-1e70-4f1d-81dd-bc80198c9acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:18.973649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2f17b542-1e70-4f1d-81dd-bc80198c9acd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:18.974774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2f17b542-1e70-4f1d-81dd-bc80198c9acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:19.013347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:19.075490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:19.359863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54446d14-55c1-406b-a41b-ac8158614a9d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:19.361456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-54446d14-55c1-406b-a41b-ac8158614a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:19.466252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54446d14-55c1-406b-a41b-ac8158614a9d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:19.505315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:19.542815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:19.543535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:19.543874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:19.544536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:19.546138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:19.653341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:19.654784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4d53-73c7-40ba-82a4-df510df0009c service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:19.674016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 730/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:21.903776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30effeca-7465-4bcf-9fc2-38bcce0089d7 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:21.904389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30effeca-7465-4bcf-9fc2-38bcce0089d7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:21.904389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30effeca-7465-4bcf-9fc2-38bcce0089d7 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:21.905703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:21.911160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6ae2-e5b1-4a65-b0c3-a196498284bc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:21.911565 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6ae2-e5b1-4a65-b0c3-a196498284bc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:21.911703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec6ae2-e5b1-4a65-b0c3-a196498284bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:21.977477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4eec6ae2-e5b1-4a65-b0c3-a196498284bc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:21.978611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4eec6ae2-e5b1-4a65-b0c3-a196498284bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:21.996730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:22.079777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:22.363688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30effeca-7465-4bcf-9fc2-38bcce0089d7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:22.365283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-30effeca-7465-4bcf-9fc2-38bcce0089d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:22.469782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30effeca-7465-4bcf-9fc2-38bcce0089d7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:22.543325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:22.550699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:22.551311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:22.551586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:22.551852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:22.553574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:22.661482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:22.662923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de4984-6f18-495f-bb46-d2411966df81 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:22.682254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 736/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:24.885281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d092-db0b-48ee-95a0-61ea5ac806ad None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:24.885847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d092-db0b-48ee-95a0-61ea5ac806ad None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:24.886816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1d092-db0b-48ee-95a0-61ea5ac806ad None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:24.888217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:24.893998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298c5f1-5abe-440e-864e-1f19b8909da9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:24.894408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298c5f1-5abe-440e-864e-1f19b8909da9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:24.894550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298c5f1-5abe-440e-864e-1f19b8909da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:24.961485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4298c5f1-5abe-440e-864e-1f19b8909da9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:24.962618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4298c5f1-5abe-440e-864e-1f19b8909da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.009892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:25.058801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:25.343402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1d092-db0b-48ee-95a0-61ea5ac806ad None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:25.345485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e8e1d092-db0b-48ee-95a0-61ea5ac806ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.449222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1d092-db0b-48ee-95a0-61ea5ac806ad None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:25.496273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:25.521821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:25.522416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:25.522688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:25.522954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:25.524549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:25.641819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:25.643289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec126b9-c9f9-4b0f-90a8-ba24939dac21 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:25.662057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 733/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:35.056994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=22 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:35.659724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=66 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:45.825493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d7fd-626e-45ed-bbf0-8b808fb9dd5d None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.826050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d7fd-626e-45ed-bbf0-8b808fb9dd5d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.826050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831d7fd-626e-45ed-bbf0-8b808fb9dd5d None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.827673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 738/1471] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:45.833441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef8a7-708c-4515-a18f-3fe5fe1e6bc2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:45.833877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef8a7-708c-4515-a18f-3fe5fe1e6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:45.834126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef8a7-708c-4515-a18f-3fe5fe1e6bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:45.902040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b06ef8a7-708c-4515-a18f-3fe5fe1e6bc2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:45.903516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b06ef8a7-708c-4515-a18f-3fe5fe1e6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:45.999550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 734/1472] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:46.299388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbede-fe60-4a0c-bcfb-7470f5aeaab1 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:46.299668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbede-fe60-4a0c-bcfb-7470f5aeaab1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:46.299942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdbede-fe60-4a0c-bcfb-7470f5aeaab1 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:46.301347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 739/1473] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 7 13:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:46.307739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837f2e-e58e-4b08-a492-4d5c107ef5c3 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:46.308032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837f2e-e58e-4b08-a492-4d5c107ef5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:46.308346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837f2e-e58e-4b08-a492-4d5c107ef5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:46.384509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0c837f2e-e58e-4b08-a492-4d5c107ef5c3 None None] MFA Rules not processed for user `50d240642e9246dbad42f8e379a60b21`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:46.385721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0c837f2e-e58e-4b08-a492-4d5c107ef5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:46.406428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:46.460686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 735/1474] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 7 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:46.468886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbede-fe60-4a0c-bcfb-7470f5aeaab1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:46.470383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fbbdbede-fe60-4a0c-bcfb-7470f5aeaab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:46.572302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdbede-fe60-4a0c-bcfb-7470f5aeaab1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:46.647856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:46.648747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:46.649021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:46.649285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:46.650936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:46.706771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:46.761921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:46.763386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d466c-5d3f-4a4c-8867-6efd86f371fb service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:46.782092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 740/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:49.051145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce441e-ead7-44ee-b254-e4f4d34e2d94 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.051666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce441e-ead7-44ee-b254-e4f4d34e2d94 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.051763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce441e-ead7-44ee-b254-e4f4d34e2d94 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.053101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 736/1476] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:49.058519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f2616-66af-4476-a6f4-865a823cfb66 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.058937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f2616-66af-4476-a6f4-865a823cfb66 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.059065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f2616-66af-4476-a6f4-865a823cfb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.127577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-175f2616-66af-4476-a6f4-865a823cfb66 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:49.128806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-175f2616-66af-4476-a6f4-865a823cfb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:49.225106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 741/1477] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:49.500095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce441e-ead7-44ee-b254-e4f4d34e2d94 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:49.501671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5fce441e-ead7-44ee-b254-e4f4d34e2d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:49.625799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce441e-ead7-44ee-b254-e4f4d34e2d94 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:49.675986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:49.720067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:49.720701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:49.720977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:49.721246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:49.721882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:49.723615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:13:49.723615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:13:49.723615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:13:49.724794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde3143-637a-45f5-828a-97994586f4af admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:49.743964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 737/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Wed Sep 7 13:13:49 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:13:51.940467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a9c5-9f82-4001-9996-2c098d23b022 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.940991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a9c5-9f82-4001-9996-2c098d23b022 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.940991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6a9c5-9f82-4001-9996-2c098d23b022 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:51.942300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 742/1479] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:51.947547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05cf5f-18c1-4c59-bf4e-333b84fa52ec None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:51.948754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05cf5f-18c1-4c59-bf4e-333b84fa52ec None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:51.948754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05cf5f-18c1-4c59-bf4e-333b84fa52ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.015944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5a05cf5f-18c1-4c59-bf4e-333b84fa52ec None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:52.017174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5a05cf5f-18c1-4c59-bf4e-333b84fa52ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.112418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 738/1480] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:52.410956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a9c5-9f82-4001-9996-2c098d23b022 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:52.413341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0da6a9c5-9f82-4001-9996-2c098d23b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.426216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:52.561432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6a9c5-9f82-4001-9996-2c098d23b022 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:52.640901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:52.674366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:52.674978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:52.675253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:52.675520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:52.677186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:52.771008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:52.772722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4684a-e87e-4499-aee4-6c1c16a76c28 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:52.791399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 743/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:55.139941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33497e-1be6-4509-a2cd-a7f934f9040a None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.140538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33497e-1be6-4509-a2cd-a7f934f9040a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.140644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33497e-1be6-4509-a2cd-a7f934f9040a None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.142237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 739/1482] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:55.147384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49107c6-8ace-48fa-90d4-ece6f1faa0ab None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.147984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49107c6-8ace-48fa-90d4-ece6f1faa0ab None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.147984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49107c6-8ace-48fa-90d4-ece6f1faa0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.216346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f49107c6-8ace-48fa-90d4-ece6f1faa0ab None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:55.217571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f49107c6-8ace-48fa-90d4-ece6f1faa0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.267153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:55.316569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 744/1483] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:13:55.603511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33497e-1be6-4509-a2cd-a7f934f9040a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:55.605097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-bc33497e-1be6-4509-a2cd-a7f934f9040a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.629508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:55.710993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33497e-1be6-4509-a2cd-a7f934f9040a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:55.783727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:55.784364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:55.784637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:55.784900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:55.786501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:55.861537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:55.896000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:55.897473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82869f36-a853-45f3-b449-fef263e7bf5a service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:55.916187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 740/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:13:58.140206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9260-3ecf-4b3e-a653-5b53308b6795 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.140735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9260-3ecf-4b3e-a653-5b53308b6795 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.140735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9260-3ecf-4b3e-a653-5b53308b6795 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.142115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 745/1485] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:13:58.147512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0023fc-6aa2-4db5-825b-441c36211721 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.147937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0023fc-6aa2-4db5-825b-441c36211721 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.148045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0023fc-6aa2-4db5-825b-441c36211721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.213656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6a0023fc-6aa2-4db5-825b-441c36211721 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:13:58.214924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6a0023fc-6aa2-4db5-825b-441c36211721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:58.312194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 741/1486] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:13:58.609534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9260-3ecf-4b3e-a653-5b53308b6795 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:13:58.611060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8c3b9260-3ecf-4b3e-a653-5b53308b6795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:58.715490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9260-3ecf-4b3e-a653-5b53308b6795 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:13:58.786753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:13:58.788559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:13:58.789163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:13:58.789439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:13:58.789705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:13:58.791297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:13:58.900549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:13:58.901975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9df1b-e170-4482-ae28-505fed643934 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:13:58.920449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 746/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:01.193088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa51a-ee03-4de4-97a9-b17475ea62bf None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.193652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa51a-ee03-4de4-97a9-b17475ea62bf None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.193652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa51a-ee03-4de4-97a9-b17475ea62bf None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.194986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 742/1488] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:14:01.200424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255b93-42eb-425d-b27a-e835b7ef251b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.200860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255b93-42eb-425d-b27a-e835b7ef251b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.200970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02255b93-42eb-425d-b27a-e835b7ef251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.267074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-02255b93-42eb-425d-b27a-e835b7ef251b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:01.268374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-02255b93-42eb-425d-b27a-e835b7ef251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.320954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:01.365380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 747/1489] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:01.661883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa51a-ee03-4de4-97a9-b17475ea62bf None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:01.663470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-27ffa51a-ee03-4de4-97a9-b17475ea62bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.699244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:01.769781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa51a-ee03-4de4-97a9-b17475ea62bf None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:01.843973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:01.844603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:01.844880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:01.845154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:01.846776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:01.927536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:01.957337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:01.958791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a66dd-6352-4b27-8687-59b617e6ea4b service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:01.977220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 743/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:04.556809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9184-fdc6-4f91-b434-b287fbf10802 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:04.557374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9184-fdc6-4f91-b434-b287fbf10802 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:04.557374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9184-fdc6-4f91-b434-b287fbf10802 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:04.558764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 748/1491] 10.222.0.57 () {54 vars in 927 bytes} [Wed Sep 7 13:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:14:04.564629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165974-f693-4079-999b-120a03dbd64d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:04.565053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165974-f693-4079-999b-120a03dbd64d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:04.565199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08165974-f693-4079-999b-120a03dbd64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:04.630610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-08165974-f693-4079-999b-120a03dbd64d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:14:04.631810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-08165974-f693-4079-999b-120a03dbd64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:04.728604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 744/1492] 10.222.0.57 () {58 vars in 1024 bytes} [Wed Sep 7 13:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:14:05.020302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9184-fdc6-4f91-b434-b287fbf10802 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:14:05.021869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bb8a9184-fdc6-4f91-b434-b287fbf10802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.126060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9184-fdc6-4f91-b434-b287fbf10802 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:14:05.198502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:14:05.199105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:14:05.199381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:14:05.199647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:14:05.201275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:14:05.210268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:05.309835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:14:05.311205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1a63c-5304-4c84-af75-459eef71f730 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:14:05.329297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 749/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:14:14.726751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=82 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:14:15.327119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=50 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:27.795928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:27.796534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:27.796534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:27.872664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:27.874502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:27.970884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 745/1494] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:27.978814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:27.979325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:27.979325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:28.057173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:28.058380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:28.153314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 750/1495] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:28.158537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:28.159753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:28.171266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f415-62fd-411d-85a4-e1d9ac7cd4a8 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:28.232280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:28.265274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:28.265882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:28.266154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:28.266418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:28.267054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:15:28.267360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:28.268394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:28.268394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:15:28.268394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:15:28.269285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:28.280946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 746/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:15:28.289326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:28.298930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b7f30-85c4-4cf1-b0d3-3c4a79e309d1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:28.359667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:28.392152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:28.392815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:28.393137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:28.393624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:28.394733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:28.396479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:28.396479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:15:28.396479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:15:28.397679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:28.544591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 751/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:15:28 2022] POST /identity/v3/projects => generated 379 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:28.548824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:28.550356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:28.583426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a0e6-f2b6-4ef9-8e27-7f4fb2630988 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:28.678630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:28.679237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:28.679512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:28.679780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:28.680448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:28.681463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:28.681463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:15:28.681463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:15:28.682665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:28.812032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 747/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:15:28 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:15:28.818529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:28.818529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:28.880206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0512efc-5c75-494e-8956-b50477204a7d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:28.962768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:28.973609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:28.974221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:28.974490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:28.978600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:28.978600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:28.978600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:28.978600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:15:28.978600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:15:28.978600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:28.989961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 752/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:28.994142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:28.995664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:29.007272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b625154-2d06-442c-aae6-e1b97d99e1bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:29.033034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:29.103935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:29.104569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:29.104846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:29.105117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:29.105753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:29.106759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:29.106759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:15:29.106759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:15:29.108299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226799e-3631-4c03-a4de-df69de4a0f52 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:29.120808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 748/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:15:29.125013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:29.126559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:29.159913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2751-ef2e-4fc4-9f2b-6456b2696dfc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:29.253256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:29.253917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:29.254195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:29.254469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] PATH_INFO: `/v3/projects/e76473a06ce84d0b8ce00c38e083d79d/users/576bb96722ab4b739fd570205e7cb43a/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:29.277114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76473a06ce84d0b8ce00c38e083d79d, user_id=576bb96722ab4b739fd570205e7cb43a, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:29.278134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:29.278134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:15:29.278134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:15:29.280732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d1f8f-ca10-4e6c-9058-c87b2e6cc03a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:29.360709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 753/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:15:29 2022] PUT /identity/v3/projects/e76473a06ce84d0b8ce00c38e083d79d/users/576bb96722ab4b739fd570205e7cb43a/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:29.373248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827572-214a-41b1-aef9-6f0c2c643c99 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:29.373695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827572-214a-41b1-aef9-6f0c2c643c99 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:29.373966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827572-214a-41b1-aef9-6f0c2c643c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:29.434712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-72827572-214a-41b1-aef9-6f0c2c643c99 None None] MFA Rules not processed for user `576bb96722ab4b739fd570205e7cb43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:29.436677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-72827572-214a-41b1-aef9-6f0c2c643c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:29.513801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 749/1502] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:15:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:29.527023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b69891-ee81-4330-b366-df684029d15a None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:29.527310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b69891-ee81-4330-b366-df684029d15a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:29.527582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b69891-ee81-4330-b366-df684029d15a None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:29.528983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 754/1503] 10.222.0.57 () {54 vars in 964 bytes} [Wed Sep 7 13:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:15:29.534040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab487bbc-346e-49b4-b079-b36f0d5f603a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:29.534322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab487bbc-346e-49b4-b079-b36f0d5f603a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:29.534623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab487bbc-346e-49b4-b079-b36f0d5f603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:29.565895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:29.608476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ab487bbc-346e-49b4-b079-b36f0d5f603a None None] MFA Rules not processed for user `6b143093bf1e4625a24a2e26ce5ba8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:29.609660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ab487bbc-346e-49b4-b079-b36f0d5f603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:29.691586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 750/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Wed Sep 7 13:15:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:29.699366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b69891-ee81-4330-b366-df684029d15a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:29.700918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e1b69891-ee81-4330-b366-df684029d15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:29.751864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:29.807689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b69891-ee81-4330-b366-df684029d15a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:29.881248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:29.881858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:29.882128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:29.882394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:29.884011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:29.985209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:29.986555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:29.990058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:30.004425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 755/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:30.051549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66d8c-5ed9-4033-b4c5-81d0ac88bb5e None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:30.051993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66d8c-5ed9-4033-b4c5-81d0ac88bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:30.052130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c66d8c-5ed9-4033-b4c5-81d0ac88bb5e None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:30.053384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 751/1506] 10.222.0.57 () {52 vars in 830 bytes} [Wed Sep 7 13:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:15:30.057092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:30.058301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:30.157449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6e78-54b8-4794-86f8-99124587bdfb service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:30.247924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:30.248511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:30.248785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:30.249051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] PATH_INFO: `/v3/users/576bb96722ab4b739fd570205e7cb43a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:30.261071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=576bb96722ab4b739fd570205e7cb43a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:30.262079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:30.262079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:15:30.262079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:15:30.263287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:30.273475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:30.517343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576bb96722ab4b739fd570205e7cb43a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:30.517797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576bb96722ab4b739fd570205e7cb43a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:30.532469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576bb96722ab4b739fd570205e7cb43a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:30.557303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576bb96722ab4b739fd570205e7cb43a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:30.557763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576bb96722ab4b739fd570205e7cb43a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:30.628233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 756/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:15:30 2022] DELETE /identity/v3/users/576bb96722ab4b739fd570205e7cb43a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:15:30.632612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:30.632918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:30.633191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:30.691039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:15:30.692280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:30.769996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:30.782401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 752/1508] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:15:30.791952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:30.793325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:30.893510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca181c0-0268-436e-8552-255e0af6ef2d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:30.948780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:30.968466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:30.969706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:30.969706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:30.969706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:30.971204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:31.084026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:31.085474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409377cb-84d3-4071-b70c-2a3f805f4d33 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:31.104076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 757/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:15:31.595769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:15:31.601211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:15:31.608451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a8e3c-d9e4-4bd5-90ad-1fe65a2da2f9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:15:31.710737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:15:31.711370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:15:31.711643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:15:31.711909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] PATH_INFO: `/v3/projects/e76473a06ce84d0b8ce00c38e083d79d` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:15:31.722831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76473a06ce84d0b8ce00c38e083d79d)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:15:31.723854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:15:31.723854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:15:31.723854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:15:31.725078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:15:31.838116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76473a06ce84d0b8ce00c38e083d79d', 'request_id': 'req-3aa4a072-2e73-41c4-928c-a47fa695c128'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:31.851659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76473a06ce84d0b8ce00c38e083d79d', 'request_id': 'req-3aa4a072-2e73-41c4-928c-a47fa695c128'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:31.857716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76473a06ce84d0b8ce00c38e083d79d', 'request_id': 'req-3aa4a072-2e73-41c4-928c-a47fa695c128'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:31.915213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] The token cache is being invalidate because project e76473a06ce84d0b8ce00c38e083d79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:15:31.915497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:31.915920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3aa4a072-2e73-41c4-928c-a47fa695c128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:15:31.917369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 753/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:15:31 2022] DELETE /identity/v3/projects/e76473a06ce84d0b8ce00c38e083d79d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:15:41.101811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=62 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:15:41.913214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:07.715595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb87d-c6bb-4850-adce-a4a0770c744b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:07.716182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb87d-c6bb-4850-adce-a4a0770c744b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:07.716182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb87d-c6bb-4850-adce-a4a0770c744b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:07.717525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:07.722530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd402-bac8-4601-92bc-ccd1df4032e1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:07.723000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd402-bac8-4601-92bc-ccd1df4032e1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:07.723098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd402-bac8-4601-92bc-ccd1df4032e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:07.802599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0b3bd402-bac8-4601-92bc-ccd1df4032e1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:07.803804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0b3bd402-bac8-4601-92bc-ccd1df4032e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:07.905403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:08.060741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb87d-c6bb-4850-adce-a4a0770c744b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:08.062942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e2edb87d-c6bb-4850-adce-a4a0770c744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:08.181334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb87d-c6bb-4850-adce-a4a0770c744b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:08.186753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d5ac-59af-4a31-b2bf-f30949bd7cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:08.187356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d5ac-59af-4a31-b2bf-f30949bd7cd7 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:08.187632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d5ac-59af-4a31-b2bf-f30949bd7cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:08.187903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d5ac-59af-4a31-b2bf-f30949bd7cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:08.195739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d5ac-59af-4a31-b2bf-f30949bd7cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:08.197346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d5ac-59af-4a31-b2bf-f30949bd7cd7 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:08.206903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 759/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:09.295225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9287-33c8-4f17-9ccc-923eba584251 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:09.295776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9287-33c8-4f17-9ccc-923eba584251 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:09.295776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9287-33c8-4f17-9ccc-923eba584251 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:09.297172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:09.303273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532989d-b26d-47c8-9d6f-5fae20880bb7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:09.303760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532989d-b26d-47c8-9d6f-5fae20880bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:09.303871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532989d-b26d-47c8-9d6f-5fae20880bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:09.323960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2532989d-b26d-47c8-9d6f-5fae20880bb7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:09.325212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2532989d-b26d-47c8-9d6f-5fae20880bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:09.333692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:09.487508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9287-33c8-4f17-9ccc-923eba584251 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:09.502094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9287-33c8-4f17-9ccc-923eba584251 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:09.507477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd32af2-c279-48e7-ab4f-e6e7acdee1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:09.508070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32af2-c279-48e7-ab4f-e6e7acdee1bd service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:09.508377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32af2-c279-48e7-ab4f-e6e7acdee1bd service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:09.508649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32af2-c279-48e7-ab4f-e6e7acdee1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:09.517148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd32af2-c279-48e7-ab4f-e6e7acdee1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:09.518729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd32af2-c279-48e7-ab4f-e6e7acdee1bd service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:09.528332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 756/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:10.040676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344f173-b5c0-4098-822b-39c681d279b8 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:10.040981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344f173-b5c0-4098-822b-39c681d279b8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:10.041309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344f173-b5c0-4098-822b-39c681d279b8 None None] PATH_INFO: `/v3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:10.042601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 761/1517] 10.222.0.77 () {54 vars in 925 bytes} [Wed Sep 7 13:17:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:17:10.057785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95767984-df0c-4d50-85f3-0719a08d5ea4 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:10.058066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95767984-df0c-4d50-85f3-0719a08d5ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:10.058339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95767984-df0c-4d50-85f3-0719a08d5ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:10.121573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-95767984-df0c-4d50-85f3-0719a08d5ea4 None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:10.122773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-95767984-df0c-4d50-85f3-0719a08d5ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:10.139411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:10.194687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 757/1518] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Sep 7 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:19.312160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44b4f9-d77b-4d68-addd-797fb7cd9c1b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:19.312614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44b4f9-d77b-4d68-addd-797fb7cd9c1b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:19.312766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44b4f9-d77b-4d68-addd-797fb7cd9c1b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:19.314084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 762/1519] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 7 13:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:19.319021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=56 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:19.319498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42e28-4b19-48e1-98f6-2cae62c08c93 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:19.319961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42e28-4b19-48e1-98f6-2cae62c08c93 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:19.320073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42e28-4b19-48e1-98f6-2cae62c08c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:19.339752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-25a42e28-4b19-48e1-98f6-2cae62c08c93 None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:19.340959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-25a42e28-4b19-48e1-98f6-2cae62c08c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:19.350022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 758/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 7 13:17:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:17:19.357572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44b4f9-d77b-4d68-addd-797fb7cd9c1b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:19.372353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44b4f9-d77b-4d68-addd-797fb7cd9c1b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:19.377430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1e4c6-5b24-45f8-84d8-8ceea4dd8fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:19.378034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e4c6-5b24-45f8-84d8-8ceea4dd8fba service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:19.378309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e4c6-5b24-45f8-84d8-8ceea4dd8fba service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:19.378627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1e4c6-5b24-45f8-84d8-8ceea4dd8fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:19.387008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1e4c6-5b24-45f8-84d8-8ceea4dd8fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:19.388740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1e4c6-5b24-45f8-84d8-8ceea4dd8fba service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:19.398676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 763/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:21.018627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219131-f6b0-4816-9a6e-b7568b524957 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:21.019150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219131-f6b0-4816-9a6e-b7568b524957 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:21.019150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04219131-f6b0-4816-9a6e-b7568b524957 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:21.020477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:21.026672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213970b6-a01c-4609-831e-8a3d35cc2c1a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:21.027090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213970b6-a01c-4609-831e-8a3d35cc2c1a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:21.027214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213970b6-a01c-4609-831e-8a3d35cc2c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:21.047211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-213970b6-a01c-4609-831e-8a3d35cc2c1a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:21.048429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-213970b6-a01c-4609-831e-8a3d35cc2c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:21.056149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:21.215056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219131-f6b0-4816-9a6e-b7568b524957 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:21.230389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04219131-f6b0-4816-9a6e-b7568b524957 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:21.235907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb52acb-48cf-4cc9-9b45-65d1dfb8c0e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:21.236520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb52acb-48cf-4cc9-9b45-65d1dfb8c0e2 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:21.236798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb52acb-48cf-4cc9-9b45-65d1dfb8c0e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:21.237068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb52acb-48cf-4cc9-9b45-65d1dfb8c0e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:21.245217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb52acb-48cf-4cc9-9b45-65d1dfb8c0e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:21.246795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb52acb-48cf-4cc9-9b45-65d1dfb8c0e2 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:21.256270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 760/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:22.333951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c498a-d230-4a1c-8963-cfdc378cd01b None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:22.334536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c498a-d230-4a1c-8963-cfdc378cd01b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:22.334536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c498a-d230-4a1c-8963-cfdc378cd01b None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:22.335840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 7 13:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:22.342076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951f52-e8d6-4c0b-b8e3-5309dacd769e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:22.342544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951f52-e8d6-4c0b-b8e3-5309dacd769e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:22.342660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951f52-e8d6-4c0b-b8e3-5309dacd769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:22.363067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3d951f52-e8d6-4c0b-b8e3-5309dacd769e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:22.364298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3d951f52-e8d6-4c0b-b8e3-5309dacd769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:22.372131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 7 13:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:22.527674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c498a-d230-4a1c-8963-cfdc378cd01b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:22.542213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29c498a-d230-4a1c-8963-cfdc378cd01b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:22.548349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287e242-7eed-45f3-bf65-6aa6c4778d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:22.548938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287e242-7eed-45f3-bf65-6aa6c4778d2b service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:22.549212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287e242-7eed-45f3-bf65-6aa6c4778d2b service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:22.549478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287e242-7eed-45f3-bf65-6aa6c4778d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:22.557374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287e242-7eed-45f3-bf65-6aa6c4778d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:22.558935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287e242-7eed-45f3-bf65-6aa6c4778d2b service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:22.568131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 766/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:26.616933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a4403-b6fb-4471-ad9b-c393ad67af13 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:26.617541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a4403-b6fb-4471-ad9b-c393ad67af13 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:26.617541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a4403-b6fb-4471-ad9b-c393ad67af13 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:26.618868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:26.624162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a2e5-9474-4f4b-8253-e12a341ef58a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:26.624595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a2e5-9474-4f4b-8253-e12a341ef58a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:26.624712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6a2e5-9474-4f4b-8253-e12a341ef58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:26.645947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cec6a2e5-9474-4f4b-8253-e12a341ef58a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:26.647142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cec6a2e5-9474-4f4b-8253-e12a341ef58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:26.654918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:26.945093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a4403-b6fb-4471-ad9b-c393ad67af13 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:26.946808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-db4a4403-b6fb-4471-ad9b-c393ad67af13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:27.025202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a4403-b6fb-4471-ad9b-c393ad67af13 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:27.028733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae562a5-fc16-44db-aff7-2fb8e8b13213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:27.029328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae562a5-fc16-44db-aff7-2fb8e8b13213 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:27.029602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae562a5-fc16-44db-aff7-2fb8e8b13213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:27.029867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae562a5-fc16-44db-aff7-2fb8e8b13213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:27.038824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae562a5-fc16-44db-aff7-2fb8e8b13213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:27.040269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae562a5-fc16-44db-aff7-2fb8e8b13213 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:27.049916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 763/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:29.198226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90a7d-e087-4df7-a08e-6e9d58b200c9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.198774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90a7d-e087-4df7-a08e-6e9d58b200c9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.198774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90a7d-e087-4df7-a08e-6e9d58b200c9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.200187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:29.206002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2c9bc-9aa2-4a4b-b7b5-7a227fa5b76e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.206449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2c9bc-9aa2-4a4b-b7b5-7a227fa5b76e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.206559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2c9bc-9aa2-4a4b-b7b5-7a227fa5b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.226237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b4a2c9bc-9aa2-4a4b-b7b5-7a227fa5b76e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:29.227425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b4a2c9bc-9aa2-4a4b-b7b5-7a227fa5b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:29.235206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:29.531087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90a7d-e087-4df7-a08e-6e9d58b200c9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:29.542058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90a7d-e087-4df7-a08e-6e9d58b200c9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:29.545541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d61e67-ffda-4f7c-ac99-55278fb0c1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:29.546137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d61e67-ffda-4f7c-ac99-55278fb0c1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:29.546411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d61e67-ffda-4f7c-ac99-55278fb0c1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:29.546718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d61e67-ffda-4f7c-ac99-55278fb0c1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:29.555594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d61e67-ffda-4f7c-ac99-55278fb0c1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:29.557114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d61e67-ffda-4f7c-ac99-55278fb0c1d3 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:29.567033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 769/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:33.316926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff19cf4-f0b0-4439-b958-bddc71641bd5 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:33.317515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff19cf4-f0b0-4439-b958-bddc71641bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:33.317515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff19cf4-f0b0-4439-b958-bddc71641bd5 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:33.318826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:33.324161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb8bc-4002-478d-b185-732a1e9b4dc7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:33.324643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb8bc-4002-478d-b185-732a1e9b4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:33.324751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb8bc-4002-478d-b185-732a1e9b4dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:33.344459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f24bb8bc-4002-478d-b185-732a1e9b4dc7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:33.345840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f24bb8bc-4002-478d-b185-732a1e9b4dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:33.353559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:33.658697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff19cf4-f0b0-4439-b958-bddc71641bd5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:33.660442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4ff19cf4-f0b0-4439-b958-bddc71641bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:33.725559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:33.739559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff19cf4-f0b0-4439-b958-bddc71641bd5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:33.743248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb40f975-cc76-4817-a388-dcc7ab7d0c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:33.743853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40f975-cc76-4817-a388-dcc7ab7d0c0f service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:33.744153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40f975-cc76-4817-a388-dcc7ab7d0c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:33.744425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb40f975-cc76-4817-a388-dcc7ab7d0c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:33.753961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40f975-cc76-4817-a388-dcc7ab7d0c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:33.755303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb40f975-cc76-4817-a388-dcc7ab7d0c0f service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:33.764516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 766/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:35.905458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eddef-3938-4a6e-ad21-ad6a79bc3f58 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:35.906012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eddef-3938-4a6e-ad21-ad6a79bc3f58 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:35.906127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eddef-3938-4a6e-ad21-ad6a79bc3f58 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:35.907895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 7 13:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:17:35.913528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9a81d-f0c4-4162-811c-7c76818277cf None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:35.913932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9a81d-f0c4-4162-811c-7c76818277cf None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:35.914116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9a81d-f0c4-4162-811c-7c76818277cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:35.933952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-76c9a81d-f0c4-4162-811c-7c76818277cf None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:17:35.935072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-76c9a81d-f0c4-4162-811c-7c76818277cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:35.943485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 7 13:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:17:36.245982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eddef-3938-4a6e-ad21-ad6a79bc3f58 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:17:36.247652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-442eddef-3938-4a6e-ad21-ad6a79bc3f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:17:36.261154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eddef-3938-4a6e-ad21-ad6a79bc3f58 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:17:36.265037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdba3c-e88b-4d3e-88dc-cacf896aea73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:17:36.265682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdba3c-e88b-4d3e-88dc-cacf896aea73 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:17:36.265957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdba3c-e88b-4d3e-88dc-cacf896aea73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:17:36.266226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdba3c-e88b-4d3e-88dc-cacf896aea73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:17:36.275180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdba3c-e88b-4d3e-88dc-cacf896aea73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:17:36.276624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdba3c-e88b-4d3e-88dc-cacf896aea73 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:17:36.287271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 772/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:17:45.929192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=11 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:17:46.283232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=33 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:12.988578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:12.989215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:12.989215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.013924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.015121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.031812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 768/1540] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.041584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.042182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.042182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.073359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.075157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.083738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 773/1541] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.088809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.104014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b5d43-3a7a-48ce-9a28-34d1e7c94b64 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.109003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.109616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.109896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.110167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.110819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:13.111119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.112916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44a92c-6946-466c-abe3-09e03247bb24 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.130272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 769/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:13.138866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.149379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d96a14-968e-46d7-8d1c-8b65dd108158 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.159287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.160300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.160581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.160851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.161499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.163409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.291169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a58d7-dfd9-44b0-a897-c5f6430cb790 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.291376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a58d7-dfd9-44b0-a897-c5f6430cb790 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.291652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a58d7-dfd9-44b0-a897-c5f6430cb790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.323771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e13a58d7-dfd9-44b0-a897-c5f6430cb790 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.330157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e13a58d7-dfd9-44b0-a897-c5f6430cb790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.330853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 774/1543] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/projects => generated 367 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:13.335255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.336560 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 770/1544] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.348924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233139e-3e18-44c4-9811-15648ec11b56 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.349243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233139e-3e18-44c4-9811-15648ec11b56 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.349479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233139e-3e18-44c4-9811-15648ec11b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.393502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0233139e-3e18-44c4-9811-15648ec11b56 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.394731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0233139e-3e18-44c4-9811-15648ec11b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.486788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd26343-3c7e-48da-b1ec-2d8d99b53a3e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.501702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:19:13.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:19:13.508460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf1654-6536-4af0-8360-8eafd2653954 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.532430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 771/1545] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.536438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6edd2-038d-4b71-b99f-d38a7ae1bb33 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.536438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6edd2-038d-4b71-b99f-d38a7ae1bb33 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.536438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6edd2-038d-4b71-b99f-d38a7ae1bb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.557850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e9d6edd2-038d-4b71-b99f-d38a7ae1bb33 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.559038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e9d6edd2-038d-4b71-b99f-d38a7ae1bb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.568573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 772/1546] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.569996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.570275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.570548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.591828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 775/1547] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:19:13.597471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.599480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.599585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.617650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.619032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.629995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.631609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.636048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 773/1548] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.642137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.646122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 776/1549] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.652858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.660512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5dac8-e26e-4252-bfba-0c1de3c0d42d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.670465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e980f-93ef-4c00-b5a7-0571146929f3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.672039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.672039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.672039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.672380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.673728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:13.673728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.675175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69054a5-34da-4069-b6b7-8c0bbed8ed03 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.675943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ff23f-c26a-43cd-9197-2a81cc17847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.681049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ff23f-c26a-43cd-9197-2a81cc17847a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.681049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ff23f-c26a-43cd-9197-2a81cc17847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.681049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ff23f-c26a-43cd-9197-2a81cc17847a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.681049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ff23f-c26a-43cd-9197-2a81cc17847a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.681049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ff23f-c26a-43cd-9197-2a81cc17847a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.689569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 774/1550] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:13.701313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd081a7-646f-4fc7-8fa0-9b5eb91aae79 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.701313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd081a7-646f-4fc7-8fa0-9b5eb91aae79 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.701313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd081a7-646f-4fc7-8fa0-9b5eb91aae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.701620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 777/1551] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:13.701620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0781-9b33-4800-8f9e-b05dcff9c1dd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.701620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0781-9b33-4800-8f9e-b05dcff9c1dd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.701620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0781-9b33-4800-8f9e-b05dcff9c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.721409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3bd081a7-646f-4fc7-8fa0-9b5eb91aae79 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.722703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3bd081a7-646f-4fc7-8fa0-9b5eb91aae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.723577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8e2c0781-9b33-4800-8f9e-b05dcff9c1dd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.725051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8e2c0781-9b33-4800-8f9e-b05dcff9c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.733576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 775/1552] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.735343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 778/1553] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.737802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8214328-3eff-45aa-add2-603df79f797b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.738543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8214328-3eff-45aa-add2-603df79f797b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.741351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8214328-3eff-45aa-add2-603df79f797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.742568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.742854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.743129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.760661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d8214328-3eff-45aa-add2-603df79f797b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.761855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d8214328-3eff-45aa-add2-603df79f797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.762821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.764105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.773588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 776/1554] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.773588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.773588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.773588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.780257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 779/1555] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.780257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.790654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edd097-dc7b-4c32-a62b-b1f42830da5b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.795892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd66029-a63e-48ae-a34c-3bd61fa933a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.798866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.798999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd66029-a63e-48ae-a34c-3bd61fa933a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.798999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd66029-a63e-48ae-a34c-3bd61fa933a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.798999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd66029-a63e-48ae-a34c-3bd61fa933a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.798999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd66029-a63e-48ae-a34c-3bd61fa933a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.799311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.799745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd66029-a63e-48ae-a34c-3bd61fa933a2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.807767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 777/1556] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.808705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.814744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 780/1557] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:13.814744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.814744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.814744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.821778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82f142-ef69-4bff-9df3-8fa0989da2c8 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.828127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.828796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.829075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.829348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.830906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.832099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:19:13.832099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:19:13.832099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:19:13.833316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf3bf6-f7a6-458c-973b-39990ec6d77a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.836781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.838086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.846909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 781/1558] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.853040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.863505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbe01a-9dcd-48d0-9878-996bb5e9fce6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.868299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.868975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.869251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.869518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.870160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:13.870461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.871473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:19:13.871473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:19:13.871473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:19:13.872442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32c33d-c8aa-487c-ad5a-e3bd95ebc117 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.885180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 782/1559] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:13.886436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.886719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.886994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.906664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.912132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.916362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 783/1560] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:13.917903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.929569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2745e75-aec5-4632-b8f8-57b212da324f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.934703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:13.935308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.935578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.935843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.936531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:13.936829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:13.938411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:13.950852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 784/1561] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:13.954765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 778/1562] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:13.954929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:13.955046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b70d-56be-408b-8d19-462134f985dc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:13.955046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b70d-56be-408b-8d19-462134f985dc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:13.955046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b70d-56be-408b-8d19-462134f985dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:13.968511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b3663-71ac-4bcc-92bd-fcac36447463 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:13.973783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7503b70d-56be-408b-8d19-462134f985dc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:13.975000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7503b70d-56be-408b-8d19-462134f985dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:13.997799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:14.025429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.026034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.026332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.026591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.027218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:14.027519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.029447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad0445-5bb8-469a-9315-8db46b000936 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.035748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 779/1563] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:14.036686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b70d-56be-408b-8d19-462134f985dc None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.043046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 785/1564] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:14.044192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.044474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.044743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.053908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b70d-56be-408b-8d19-462134f985dc None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.059783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.059783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.059783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.059783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] PATH_INFO: `/v3/projects/3fca63d3c3914fd18e6013ca938906f8/users/75d0370ea29d439c929d510fbd6bce5e/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.062109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:14.064517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:14.065728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:14.073748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 786/1565] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:14.075065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fca63d3c3914fd18e6013ca938906f8, user_id=75d0370ea29d439c929d510fbd6bce5e, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.076146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:19:14.076146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:19:14.076146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:19:14.078209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.078481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.088866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c70cb-e98b-412e-97d4-c8d28405f019 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.093591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.094183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.094461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.094733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.095361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.097325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.200948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 780/1566] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:14 2022] PUT /identity/v3/projects/3fca63d3c3914fd18e6013ca938906f8/users/75d0370ea29d439c929d510fbd6bce5e/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:14.202030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.215869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 787/1567] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/projects => generated 355 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.216887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.265832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfacc5b-15e1-4e86-b513-de61ebc0b0dc admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.282013 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa19b-0c95-4f7d-a9d3-78d0c5884f2a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.288268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.289499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.289773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.290034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.290972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.292653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.323081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.323598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.323871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.324191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.324878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:14.325175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.326764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.338693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 781/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:14.339470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.349025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5ebb8-1d0d-454d-a488-813b714a5245 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.354358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.354937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.355211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.355475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.356120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.358034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.367283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 788/1569] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.368689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.379038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa985-68ec-4ce0-a6ee-b96cc6eff187 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.384721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.385467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.385747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.386017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.387166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:14.387166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.388633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.408265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 789/1570] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:14.408265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.411875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f8f11-5426-4aa7-b998-25ef75e3bcb0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.416553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb1735-5ddd-48c7-b23b-7a5325f3d0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.417130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1735-5ddd-48c7-b23b-7a5325f3d0fc admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.417401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1735-5ddd-48c7-b23b-7a5325f3d0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.417669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb1735-5ddd-48c7-b23b-7a5325f3d0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.418278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb1735-5ddd-48c7-b23b-7a5325f3d0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.420183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb1735-5ddd-48c7-b23b-7a5325f3d0fc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.454837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 782/1571] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.455769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.514482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 790/1572] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.514482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.514482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.514482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.520168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655337-c36d-4211-92e4-94c9a1870e52 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.525804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:14.543073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] MFA Rules not processed for user `75d0370ea29d439c929d510fbd6bce5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:14.544334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:14.577436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.582115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.582115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.582115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.582115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:14.582115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.582115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.591705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:14.597238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 783/1573] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:14.601149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.608164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09519f-2640-4c9b-9157-f247d3dcffc8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.612712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.613309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.613591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.613860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.614505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.616542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.617315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 791/1574] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:14.618255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.629198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec81ee2-7af6-4d2e-8d38-8df46d4e9a7f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.634638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.636113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.636113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.636436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.636975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.638861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.669965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 784/1575] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/users => generated 278 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.670847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.680754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127d6c3-15c4-4679-abad-aca2e98d967f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.685250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.685825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.686098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.686362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.686989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.688614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.699519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 785/1576] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:14.703424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 792/1577] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.705158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.705305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.713795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022219c-a0fd-4166-8792-0b55a47c8edd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.765314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153bd40-ff84-464c-a80a-ffe1edf296b4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.770010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.770609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.770865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.770992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.771467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.771744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.771876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.772018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.772434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.772685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.774359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.774617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.890536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 793/1578] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.890536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.898266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71eb380-f9e3-47fb-8a8d-c4c8e76dfe99 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.902985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.903565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.903839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.904129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.904748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.906671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.911748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 786/1579] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:14.912821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:14.973545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c4b7-6dd3-417b-8d50-774de69e56e0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:14.978210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:14.978810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:14.979086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:14.979355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:14.979979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:14.982122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:14.986457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:15.001248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 794/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:15.002073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.057544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bf22d-b91a-4a69-822d-baa75378bb2f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.100575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:15.105998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 787/1581] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:14 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:15.106480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.106725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.106995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.107256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.108003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.168413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.170042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.171951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec34e0a-9847-4259-bd92-e9afec44f2fa admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.176990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.177604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.177918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.178149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.178793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.180032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 795/1582] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:15.180974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.181359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.191820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b4ea6-7fe1-45ee-b694-02107b53fbd9 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.195404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 788/1583] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.195404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.196636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.197105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.197380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.197644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.198284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.200287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.204748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c9661-cfcb-4298-b9bc-ae2d01a8589c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.209685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.210315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.210644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.210919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.211577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.215209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 796/1584] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.215209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.215367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.225144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68cc25-fbf3-4549-ab26-a77581502e77 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.230929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.231534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.231813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.232095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.232825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.234430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.245346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 797/1585] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.246125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.256531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eff095-e52f-45b0-baf9-831be25b7002 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.261322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.261963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.262243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.262533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.263153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.265070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.298542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 789/1586] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:15 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:15.299548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.310546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b1d0b-b430-4810-9386-e0b8aa7cc220 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.315895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.316613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.316922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.317196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.317846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.319550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.331057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 790/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.332172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.342347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 798/1588] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:15 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:15.343252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.344045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6ff81-fea0-4fe5-8e3b-57a56a490edf admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.349708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.350359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.350640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.350913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.352064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.354484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a584e-ee14-4159-a453-47fd4d1694a1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.354638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.359344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.359942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.360249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.360518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.361174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.362738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.374194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 799/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.378205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.388392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e18bc-f69d-4a01-baa2-2ae0f3a8ea11 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.395230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.395899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.396210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.396482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] PATH_INFO: `/v3/projects/72d597829f444df884cad95b8c7f5fdf/users/8d59f3fa17ef483a841ffd5b62ca3059/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.411531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d597829f444df884cad95b8c7f5fdf, user_id=8d59f3fa17ef483a841ffd5b62ca3059, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.415208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.475934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 791/1590] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:15 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:15.477236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.486482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82088e74-4c92-45df-8377-69adb74d516e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.491066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.491687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.492506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.492778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.493402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.494990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.504541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 800/1591] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:15 2022] PUT /identity/v3/projects/72d597829f444df884cad95b8c7f5fdf/users/8d59f3fa17ef483a841ffd5b62ca3059/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:15.504867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 792/1592] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.505374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.505715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.520512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370bf9-08e6-4d98-9b7d-833b64271f0b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.574056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48ed72-3d08-4782-81eb-fc01ef87a976 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.579068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.579811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.580256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.580506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.581146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.582743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.586522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.587155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.587512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.587873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.588548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.590135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.593465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 801/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.594387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.600226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 793/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.601063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.605350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c556313-4878-419f-8795-61fa5bc6967c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.610337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.610952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.611508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684bcf-f628-43c5-a119-bf7dc25138b4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.611626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.611626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.612214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.613791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.615991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.616794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.617142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.617514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] PATH_INFO: `/v3/projects/66becf2b68cd42b59741f8db84430bd4/users/119010358acb4b1aa4b49f70a06a2007/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.623778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 802/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.624692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.634053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66becf2b68cd42b59741f8db84430bd4, user_id=119010358acb4b1aa4b49f70a06a2007, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.635414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f8a6-2c71-4aac-82d3-3f106fecc8eb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.637050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.640198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79f52d-0467-45f0-81d9-0f82d5366237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.640794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:15.640932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f52d-0467-45f0-81d9-0f82d5366237 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.641186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f52d-0467-45f0-81d9-0f82d5366237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.641454 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79f52d-0467-45f0-81d9-0f82d5366237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.642075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79f52d-0467-45f0-81d9-0f82d5366237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.643759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79f52d-0467-45f0-81d9-0f82d5366237 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.652354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:15.659849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 803/1596] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.659849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.660355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.661592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.688858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] MFA Rules not processed for user `8d59f3fa17ef483a841ffd5b62ca3059`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:15.690182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:15.719675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 794/1597] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:15 2022] PUT /identity/v3/projects/66becf2b68cd42b59741f8db84430bd4/users/119010358acb4b1aa4b49f70a06a2007/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:15.719675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.764897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 804/1598] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:15.765731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.776463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9f64-657c-42cb-b26e-4699c29b2ce9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.781047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.781646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.781925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.782289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.782408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256525c9-4805-4fc8-83c5-296e87c8f7b5 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.783033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.784669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.787136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.787791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.788067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.788364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] PATH_INFO: `/v3/projects/114e8e1e21f64769944d92d7bd9db345/users/438568aef00b421da7419f77a2fd7180/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.795295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 805/1599] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:15.796110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.803796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] RBAC: Authorizing `identity:create_grant(project_id=114e8e1e21f64769944d92d7bd9db345, user_id=438568aef00b421da7419f77a2fd7180, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.805755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb3548-5b83-458e-8b85-2d173c7b09a7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:15.806661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.810527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:15.811178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:15.811456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:15.811725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] PATH_INFO: `/v3/projects/44b7084e807a4fde9f07303179599b96/users/cb3e13c85e8545afab44389368eb91dd/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:15.826884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b7084e807a4fde9f07303179599b96, user_id=cb3e13c85e8545afab44389368eb91dd, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:15.829702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:15.909671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 795/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:15 2022] PUT /identity/v3/projects/114e8e1e21f64769944d92d7bd9db345/users/438568aef00b421da7419f77a2fd7180/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:15.910895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.938986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 806/1601] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:15 2022] PUT /identity/v3/projects/44b7084e807a4fde9f07303179599b96/users/cb3e13c85e8545afab44389368eb91dd/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:15.938986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:15.975826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd63025-5ef2-4006-80d0-fcfbc565719b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.000730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b33d-0832-435b-9f21-6a07f738f717 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.005563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390aa90-5a6b-491a-91f1-10e3916ab410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.006170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390aa90-5a6b-491a-91f1-10e3916ab410 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.006444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390aa90-5a6b-491a-91f1-10e3916ab410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.006710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390aa90-5a6b-491a-91f1-10e3916ab410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.007864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390aa90-5a6b-491a-91f1-10e3916ab410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.009473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390aa90-5a6b-491a-91f1-10e3916ab410 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.019618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 807/1602] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:16.021460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.021802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.022213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.033001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.033816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.040207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.040207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.040207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.040207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.051300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 796/1603] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:16.051300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.052582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] MFA Rules not processed for user `119010358acb4b1aa4b49f70a06a2007`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:16.054059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.060882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352c0b2-0908-463e-a4ab-71d5da2120eb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.066449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9fa6-bacf-4bc4-b4ee-1884693d468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.066900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9fa6-bacf-4bc4-b4ee-1884693d468d admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.067186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9fa6-bacf-4bc4-b4ee-1884693d468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.067462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9fa6-bacf-4bc4-b4ee-1884693d468d admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.068117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e9fa6-bacf-4bc4-b4ee-1884693d468d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.070605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e9fa6-bacf-4bc4-b4ee-1884693d468d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.111249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:16.135359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 808/1604] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:16.136211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.146861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4376d-b843-4a20-b9f7-3cdd99fa7bcb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.152060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.152799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.153081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.153378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] PATH_INFO: `/v3/projects/ca2bf3d4373c4714aa4ea10fad238a26/users/70f457820bed433881d1bcd0b6ec1540/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.169393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2bf3d4373c4714aa4ea10fad238a26, user_id=70f457820bed433881d1bcd0b6ec1540, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.171806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.177149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:16.187516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 797/1605] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:16.189048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b659-aaeb-4ad8-aff4-f39ee78f2006 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.189336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b659-aaeb-4ad8-aff4-f39ee78f2006 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.189614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614b659-aaeb-4ad8-aff4-f39ee78f2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.210201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0614b659-aaeb-4ad8-aff4-f39ee78f2006 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:16.211473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0614b659-aaeb-4ad8-aff4-f39ee78f2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.271963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 798/1606] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:16.273208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.273491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.273798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.293340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:16.294468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 809/1607] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:16 2022] PUT /identity/v3/projects/ca2bf3d4373c4714aa4ea10fad238a26/users/70f457820bed433881d1bcd0b6ec1540/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:16.294610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.295540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.357593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 799/1608] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:16.358426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.367582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2abf2e-e736-47f7-8c81-df677ddce1dc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.369058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee8062-e991-4d06-bc40-b3948515543d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.372727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.373405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.373684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.373961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] PATH_INFO: `/v3/projects/9d4081c8b6f84e0cb3122138a4dfe2a8/users/864b75daee8340068c331b31fa4f1b73/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.374772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.375423 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.375701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.375970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] PATH_INFO: `/v3/projects/2144ce1726b34564921080dfa33ec945/users/c650fb007aad4a42ae13906b127bd6a6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.390926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4081c8b6f84e0cb3122138a4dfe2a8, user_id=864b75daee8340068c331b31fa4f1b73, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.393621 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.394596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2144ce1726b34564921080dfa33ec945, user_id=c650fb007aad4a42ae13906b127bd6a6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.397519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.492588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 810/1609] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:16 2022] PUT /identity/v3/projects/9d4081c8b6f84e0cb3122138a4dfe2a8/users/864b75daee8340068c331b31fa4f1b73/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:16.493269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.503480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 800/1610] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:16 2022] PUT /identity/v3/projects/2144ce1726b34564921080dfa33ec945/users/c650fb007aad4a42ae13906b127bd6a6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:16.507794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.566864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705da4-6652-4f17-90c5-3597ba6f9445 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.579008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f5d4-95e2-427e-bed8-241c11412545 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.584949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.586521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.586948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.587236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.587868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.589846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.616198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:16.629174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9264d4f-e6d6-4cd8-a8c6-549f8dc3ef0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.629817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264d4f-e6d6-4cd8-a8c6-549f8dc3ef0b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.630098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264d4f-e6d6-4cd8-a8c6-549f8dc3ef0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.630398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264d4f-e6d6-4cd8-a8c6-549f8dc3ef0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.631093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264d4f-e6d6-4cd8-a8c6-549f8dc3ef0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.633633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264d4f-e6d6-4cd8-a8c6-549f8dc3ef0b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.675763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 801/1611] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:16.676653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.685517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:16.731498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e40ec-9007-49ac-bfe0-9d360f01388a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.735101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.735732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.736004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.736293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.748172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 811/1612] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/projects => generated 355 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:16.748342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.748439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49409-4683-4458-9995-538c35eb8564 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.748545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.748634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49409-4683-4458-9995-538c35eb8564 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.748634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e49409-4683-4458-9995-538c35eb8564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.756848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 802/1613] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:16.758175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.759544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.767297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-00e49409-4683-4458-9995-538c35eb8564 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:16.768808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-00e49409-4683-4458-9995-538c35eb8564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.771710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e843b-48e5-4f0c-ab13-4bfa39290bfb service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.823624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c23bb-9cf7-4f50-a5c8-c32e7b96f74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.824191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c23bb-9cf7-4f50-a5c8-c32e7b96f74d service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.824578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c23bb-9cf7-4f50-a5c8-c32e7b96f74d service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.824854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c23bb-9cf7-4f50-a5c8-c32e7b96f74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.829435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 812/1614] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:16.830678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.830984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.831227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.837254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c23bb-9cf7-4f50-a5c8-c32e7b96f74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.838773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c23bb-9cf7-4f50-a5c8-c32e7b96f74d service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.848942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 803/1615] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:16.850321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.850801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.851105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.862326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] MFA Rules not processed for user `864b75daee8340068c331b31fa4f1b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:16.863689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.877315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:16.878630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:16.890492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 804/1616] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:16.890492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.903080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c2d5d-f611-4826-86a4-db416f5ff980 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.909665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.910542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.910821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.911116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.911839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.913725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.933487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 805/1617] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:16.934424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.949674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3b5a6-8294-486e-ba99-ccec3ca73073 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.954649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.955266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.958807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.958939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 813/1618] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:16.959914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.959914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.960148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:16.960243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.968108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40449ff-a92f-4f32-b2ad-35cff36a0ed6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:16.972334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:16.972941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:16.973214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:16.973480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:16.983213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:16.984680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:16.995677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 814/1619] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:16.996442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.004256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd48b6a-702f-448e-9843-eefbc2adcfcb service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.008584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.009174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.011298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.011298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.019008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.020460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.030932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 815/1620] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:17.031650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.034573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 806/1621] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:16 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:17.034573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.042421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1666694-c3b6-4e4d-863d-a0476b8e4889 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.044736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb8e53-3f93-40ef-8e49-40b6df511f14 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.047335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.047996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.048298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.048706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] PATH_INFO: `/v3/projects/60f90db8c62f486589993598650e89d5/users/112ca7620d864182abd7dcd04c910f2e/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.051352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.052129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.052589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.052977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.053918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.056997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.069722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f90db8c62f486589993598650e89d5, user_id=112ca7620d864182abd7dcd04c910f2e, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.073398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.136524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 816/1622] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:17 2022] PUT /identity/v3/projects/60f90db8c62f486589993598650e89d5/users/112ca7620d864182abd7dcd04c910f2e/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:17.137702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.147175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 807/1623] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:17 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:17.148840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.153661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:17.268700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74855a1-b9da-4555-b307-00b04d90253d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.275370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:17.288823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.289660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.290009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.291511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.291715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.292610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99275d-b265-4350-8371-eca859842a70 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.297123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.300432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.300432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.300432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.300432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.300871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.303068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.315659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 808/1624] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:17.316346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.325357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 817/1625] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:17.325828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.333043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7595bf-35dd-42ce-a1ec-a41d747049f4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.338054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398c80c-1203-4df6-adfa-c9e1acadcdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.339021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c80c-1203-4df6-adfa-c9e1acadcdbb admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.339256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c80c-1203-4df6-adfa-c9e1acadcdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.339817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398c80c-1203-4df6-adfa-c9e1acadcdbb admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.340541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c80c-1203-4df6-adfa-c9e1acadcdbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.343094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398c80c-1203-4df6-adfa-c9e1acadcdbb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.346541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd658a8-f5ab-479c-ac84-4374a4e7bd3a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.352072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.352979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.353309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.353663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] PATH_INFO: `/v3/projects/60f90db8c62f486589993598650e89d5/users/112ca7620d864182abd7dcd04c910f2e/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.355884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f90db8c62f486589993598650e89d5, user_id=112ca7620d864182abd7dcd04c910f2e, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.358802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.371649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 818/1626] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:17 2022] PUT /identity/v3/projects/60f90db8c62f486589993598650e89d5/users/112ca7620d864182abd7dcd04c910f2e/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:17.373212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.474327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec30da1-8783-46c9-82ce-38a72c0f2ff6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.482922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 809/1627] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:17 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:17.486129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.486942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.487198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.487339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.489368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.490365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.490852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] PATH_INFO: `/v3/projects/bc927b0e928d46a1ae0f4d08f8d195aa/users/3e5697b70fa14659be98cb8b6344bedb/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.515691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc927b0e928d46a1ae0f4d08f8d195aa, user_id=3e5697b70fa14659be98cb8b6344bedb, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.519350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.569926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] MFA Rules not processed for user `112ca7620d864182abd7dcd04c910f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:17.571312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:17.624931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 819/1628] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:17 2022] PUT /identity/v3/projects/bc927b0e928d46a1ae0f4d08f8d195aa/users/3e5697b70fa14659be98cb8b6344bedb/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:17.624931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.685228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 810/1629] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:17.687936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.725743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c4391-289d-478d-9948-e2905656d9d5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.751593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26c508-73f8-47b7-833b-11e121a7b99c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.758971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.760628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.763269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.763551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.764268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.765907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.780329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 820/1630] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:17.781445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.799815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:17.854528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8753f-9bc2-44f6-afe1-bb95943437c3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.859188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.861036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.861495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.861857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.863952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.864698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.865073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.865459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.866357 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.869227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.882347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 811/1631] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:17.883322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:17.916174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27354b10-59db-4c0c-a1aa-ecdbf4e45bf9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:17.933081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:17.934366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:17.934945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:17.935377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] PATH_INFO: `/v3/projects/38a2ca2e2f444b60b3bcda9c3d554a32/users/67f1a6d0deaa41d3a6aaa7a4d9041541/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:17.968571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a2ca2e2f444b60b3bcda9c3d554a32, user_id=67f1a6d0deaa41d3a6aaa7a4d9041541, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.971965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.978390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:17.980475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:17.997535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 821/1632] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:17.998458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:18.008965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d0a40-03c3-4d89-a000-fb4b0a5ad3bc service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:18.014119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0732dd66-1ff1-4377-95e0-0c1e42e98423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:18.014916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dd66-1ff1-4377-95e0-0c1e42e98423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.020961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dd66-1ff1-4377-95e0-0c1e42e98423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.020961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732dd66-1ff1-4377-95e0-0c1e42e98423 admin admin] PATH_INFO: `/v3/projects/bc927b0e928d46a1ae0f4d08f8d195aa/users/3e5697b70fa14659be98cb8b6344bedb/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.020961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732dd66-1ff1-4377-95e0-0c1e42e98423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc927b0e928d46a1ae0f4d08f8d195aa, user_id=3e5697b70fa14659be98cb8b6344bedb, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:18.020961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0732dd66-1ff1-4377-95e0-0c1e42e98423 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:18.033027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 822/1633] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:17 2022] PUT /identity/v3/projects/bc927b0e928d46a1ae0f4d08f8d195aa/users/3e5697b70fa14659be98cb8b6344bedb/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:18.044109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.049690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.049690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.072039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] MFA Rules not processed for user `3e5697b70fa14659be98cb8b6344bedb`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:18.073399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:18.088331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 812/1634] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:17 2022] PUT /identity/v3/projects/38a2ca2e2f444b60b3bcda9c3d554a32/users/67f1a6d0deaa41d3a6aaa7a4d9041541/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:18.091929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:18.129339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:18.161373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c325-4693-4588-ba54-db969ee2ffff admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:18.163943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 823/1635] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:18.172505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:18.173299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.173672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.331106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.331106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:18.336004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:18.336322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:18.336322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 813/1636] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:19:18.336322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:18.336322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555b5f-6b46-466c-8c22-a76dcc8e3c30 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:18.336655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e9b07-5750-4697-9e64-fe6594208105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:18.336655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9b07-5750-4697-9e64-fe6594208105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.336655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9b07-5750-4697-9e64-fe6594208105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.336655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e9b07-5750-4697-9e64-fe6594208105 admin admin] PATH_INFO: `/v3/projects/38a2ca2e2f444b60b3bcda9c3d554a32/users/67f1a6d0deaa41d3a6aaa7a4d9041541/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.337110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9b07-5750-4697-9e64-fe6594208105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a2ca2e2f444b60b3bcda9c3d554a32, user_id=67f1a6d0deaa41d3a6aaa7a4d9041541, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:18.337110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e9b07-5750-4697-9e64-fe6594208105 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:18.337110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 814/1637] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:18 2022] PUT /identity/v3/projects/38a2ca2e2f444b60b3bcda9c3d554a32/users/67f1a6d0deaa41d3a6aaa7a4d9041541/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:18.337294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191f3b0-c473-45c8-aacb-40a99af042cd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:18.337365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.337365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.337365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.337537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:18.337611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] MFA Rules not processed for user `67f1a6d0deaa41d3a6aaa7a4d9041541`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:18.337611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:18.337731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:18.337731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.337731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.337731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.420004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 815/1638] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:18.421214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:18.429503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:18.431232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:18.434662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e318216-7ec2-4c94-ba4e-837a99622d09 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:18.438765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1b171-65a9-494f-a94a-6c1af8dde0c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:18.439335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b171-65a9-494f-a94a-6c1af8dde0c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.439626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b171-65a9-494f-a94a-6c1af8dde0c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.440112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1b171-65a9-494f-a94a-6c1af8dde0c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.446736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 824/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:18.513798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b171-65a9-494f-a94a-6c1af8dde0c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:18.515287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1b171-65a9-494f-a94a-6c1af8dde0c3 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:18.525448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 816/1640] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:18.678709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:18.735116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241e6c3-4631-43a7-b88d-67495861fb9d service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:18.746796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8bc007-72cf-4b76-85f1-5963d78c5653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:18.748031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bc007-72cf-4b76-85f1-5963d78c5653 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:18.748551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bc007-72cf-4b76-85f1-5963d78c5653 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:18.749718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8bc007-72cf-4b76-85f1-5963d78c5653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:18.862309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bc007-72cf-4b76-85f1-5963d78c5653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:18.864890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8bc007-72cf-4b76-85f1-5963d78c5653 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:18.877762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 825/1641] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:19.024494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4972-06ad-4780-b442-05b376021600 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:19.025098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4972-06ad-4780-b442-05b376021600 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:19.025562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4972-06ad-4780-b442-05b376021600 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:19.027897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 817/1642] 10.222.0.57 () {54 vars in 962 bytes} [Wed Sep 7 13:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:19:19.035752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a1449-faba-458a-88bc-f904fcc237d2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:19.037524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a1449-faba-458a-88bc-f904fcc237d2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:19.038327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a1449-faba-458a-88bc-f904fcc237d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:19.097183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a89a1449-faba-458a-88bc-f904fcc237d2 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:19.099054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a89a1449-faba-458a-88bc-f904fcc237d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:19.247042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 826/1643] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Sep 7 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:19.250224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4972-06ad-4780-b442-05b376021600 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:19.252907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b139e4-b748-4ab9-b9e4-5b662bc7d535 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:19.253426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b139e4-b748-4ab9-b9e4-5b662bc7d535 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:19.253730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b139e4-b748-4ab9-b9e4-5b662bc7d535 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:19.256618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 827/1644] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 7 13:19:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:19:19.267392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:19.268762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4972-06ad-4780-b442-05b376021600 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:19.269745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:19.270181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:19.281877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:19.296735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:19.297068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:19.297301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:19.311077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:19.312503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:19.325357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 828/1645] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:19:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:19.362187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:19.396309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:19.407997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:19.409710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:19.423539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 818/1646] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:19.877737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:19.893647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3307-c674-4954-952c-00eedae6e287 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:19.904251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1f6e4-24e8-4112-8158-bd722fe65666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:19.904401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f6e4-24e8-4112-8158-bd722fe65666 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:19.904808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f6e4-24e8-4112-8158-bd722fe65666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:19.904976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f6e4-24e8-4112-8158-bd722fe65666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:19.932158 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1f6e4-24e8-4112-8158-bd722fe65666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:19.933605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1f6e4-24e8-4112-8158-bd722fe65666 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:19.967562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 829/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:24.400472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:24.412137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42b4ef-93cf-4840-9b73-ad53259c9b44 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:24.438947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf0b8-0148-43b0-b0bb-e7d87c031ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:24.441342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf0b8-0148-43b0-b0bb-e7d87c031ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:24.441731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf0b8-0148-43b0-b0bb-e7d87c031ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:24.442143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf0b8-0148-43b0-b0bb-e7d87c031ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:24.476703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf0b8-0148-43b0-b0bb-e7d87c031ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:24.480696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf0b8-0148-43b0-b0bb-e7d87c031ff5 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:24.541531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 819/1648] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:25.033563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7650f6-e170-440f-90b7-526a66b1e257 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:25.034040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7650f6-e170-440f-90b7-526a66b1e257 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:25.034177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7650f6-e170-440f-90b7-526a66b1e257 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:25.035767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 830/1649] 10.222.0.57 () {54 vars in 962 bytes} [Wed Sep 7 13:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:19:25.053561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27170-6db2-4549-825c-0c187a4a7360 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:25.054174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27170-6db2-4549-825c-0c187a4a7360 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:25.054592 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d27170-6db2-4549-825c-0c187a4a7360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:25.109923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-14d27170-6db2-4549-825c-0c187a4a7360 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:25.111489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-14d27170-6db2-4549-825c-0c187a4a7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:25.137971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 820/1650] 10.222.0.57 () {58 vars in 1059 bytes} [Wed Sep 7 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:25.143837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec3bea-f4e9-4d0a-9af3-ea8f7dfd00d3 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:25.144363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec3bea-f4e9-4d0a-9af3-ea8f7dfd00d3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:25.144957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baec3bea-f4e9-4d0a-9af3-ea8f7dfd00d3 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:25.146810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 831/1651] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 7 13:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:19:25.153888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd291-868c-4c5d-94f7-64245f265c2c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:25.154461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd291-868c-4c5d-94f7-64245f265c2c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:25.154874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edd291-868c-4c5d-94f7-64245f265c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:25.201473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a3edd291-868c-4c5d-94f7-64245f265c2c None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:25.202748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a3edd291-868c-4c5d-94f7-64245f265c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:25.222592 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 821/1652] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:25.236731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec3bea-f4e9-4d0a-9af3-ea8f7dfd00d3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:25.254237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baec3bea-f4e9-4d0a-9af3-ea8f7dfd00d3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:25.264165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d5496-1e29-4e02-8861-58d462247fd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:25.264803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5496-1e29-4e02-8861-58d462247fd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:25.265080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5496-1e29-4e02-8861-58d462247fd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:25.265410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5496-1e29-4e02-8861-58d462247fd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:25.283712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d5496-1e29-4e02-8861-58d462247fd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:25.285094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d5496-1e29-4e02-8861-58d462247fd3 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:25.312152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 832/1653] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:29.200753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:29.203140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:29.203724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:29.268033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] MFA Rules not processed for user `438568aef00b421da7419f77a2fd7180`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:29.273625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:29.420279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 822/1654] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:29.430585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8f2d2-a4d0-450e-a284-2558b42d1462 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:29.431484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8f2d2-a4d0-450e-a284-2558b42d1462 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:29.431755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8f2d2-a4d0-450e-a284-2558b42d1462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:29.497708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a2a8f2d2-a4d0-450e-a284-2558b42d1462 None None] MFA Rules not processed for user `438568aef00b421da7419f77a2fd7180`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:29.499251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a2a8f2d2-a4d0-450e-a284-2558b42d1462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:29.515198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 833/1655] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:29.531710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:29.546115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad277e2-5ee6-44e7-abeb-6b6acc1f23b8 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:29.561938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:29.562680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:29.562845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:29.564408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:29.584438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:29.586918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:29.621995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 823/1656] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:19:29.755971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0b09-37ea-4c75-bdfe-3908ae245d0b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:29.755971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0b09-37ea-4c75-bdfe-3908ae245d0b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:29.755971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0b09-37ea-4c75-bdfe-3908ae245d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:29.851542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-48ee0b09-37ea-4c75-bdfe-3908ae245d0b None None] MFA Rules not processed for user `cb3e13c85e8545afab44389368eb91dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:29.867254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48ee0b09-37ea-4c75-bdfe-3908ae245d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:30.042235 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 834/1657] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:30.181583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:30.199422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0295a4-1e5c-4ab5-9d0a-a2193f48e157 service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:30.218255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162658ac-a531-4e05-98e2-e890888a4c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:30.218918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162658ac-a531-4e05-98e2-e890888a4c35 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:30.219142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162658ac-a531-4e05-98e2-e890888a4c35 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:30.219590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162658ac-a531-4e05-98e2-e890888a4c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:30.266878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162658ac-a531-4e05-98e2-e890888a4c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:30.278163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162658ac-a531-4e05-98e2-e890888a4c35 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:30.317332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 824/1658] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:30.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34648e4-f219-42aa-ad79-8fe288c22855 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:30.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34648e4-f219-42aa-ad79-8fe288c22855 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:30.859693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34648e4-f219-42aa-ad79-8fe288c22855 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:30.860262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 835/1659] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 7 13:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:19:30.866251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:30.867077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:30.867350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:30.996523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:30.998031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:31.115458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 825/1660] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:31.129358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34648e4-f219-42aa-ad79-8fe288c22855 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:31.151032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34648e4-f219-42aa-ad79-8fe288c22855 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:31.155853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f2a24-bd7b-4645-867a-0958064b4343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:31.156806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2a24-bd7b-4645-867a-0958064b4343 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:31.157495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2a24-bd7b-4645-867a-0958064b4343 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:31.157894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f2a24-bd7b-4645-867a-0958064b4343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:31.175918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f2a24-bd7b-4645-867a-0958064b4343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:31.177520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f2a24-bd7b-4645-867a-0958064b4343 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:31.195611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 836/1661] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:19:32.001546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:32.015446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:32.071486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488157e9-39d8-455f-8bf2-c71d61012c7b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:32.071990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488157e9-39d8-455f-8bf2-c71d61012c7b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:32.072069 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488157e9-39d8-455f-8bf2-c71d61012c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:32.127840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-488157e9-39d8-455f-8bf2-c71d61012c7b None None] MFA Rules not processed for user `438568aef00b421da7419f77a2fd7180`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:32.131476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-488157e9-39d8-455f-8bf2-c71d61012c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:32.152498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 837/1662] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:32.208490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee95be9-8b9b-45db-98ac-9d322ec91a47 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:32.222738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:32.232129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:32.239375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:32.239375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:32.247690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:32.283092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:32.286026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8abadb-92f9-4a8a-b67d-3acd699ee4ec service placement] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:32.299440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 826/1663] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:19:32.754199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:32.754474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:32.754719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:32.831468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] MFA Rules not processed for user `70f457820bed433881d1bcd0b6ec1540`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:32.834275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:32.938531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:33.034801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 838/1664] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:33.049267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a47a0-4da6-4293-b640-5e6195784528 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:33.049714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a47a0-4da6-4293-b640-5e6195784528 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:33.049714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a47a0-4da6-4293-b640-5e6195784528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:33.125104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f47a47a0-4da6-4293-b640-5e6195784528 None None] MFA Rules not processed for user `70f457820bed433881d1bcd0b6ec1540`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:33.126623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f47a47a0-4da6-4293-b640-5e6195784528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:33.174436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 827/1665] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:33.180069 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:33.208963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed8249b-02c5-4f13-96d6-0882bec9b994 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:33.222183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:33.222828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:33.223128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:33.223377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:33.247224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:33.252239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:33.298050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 839/1666] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:33.754307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946044-e2ea-4ff9-9802-beebba38287e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:33.754816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946044-e2ea-4ff9-9802-beebba38287e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:33.755302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73946044-e2ea-4ff9-9802-beebba38287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:33.850429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-73946044-e2ea-4ff9-9802-beebba38287e None None] MFA Rules not processed for user `c650fb007aad4a42ae13906b127bd6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:33.855319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-73946044-e2ea-4ff9-9802-beebba38287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:34.011908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 828/1667] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:34.030775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:34.045783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581059-62f8-42ab-9ef8-40f2632f9e2a service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:34.063048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664908bb-e162-422d-86eb-2f2a6834c24b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:34.063901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664908bb-e162-422d-86eb-2f2a6834c24b service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:34.064360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664908bb-e162-422d-86eb-2f2a6834c24b service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:34.069504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664908bb-e162-422d-86eb-2f2a6834c24b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:34.078675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664908bb-e162-422d-86eb-2f2a6834c24b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:34.083253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664908bb-e162-422d-86eb-2f2a6834c24b service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:34.106666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 840/1668] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:34.292579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be141c8-e852-4f98-be0d-6007f27a02af None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:34.292579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be141c8-e852-4f98-be0d-6007f27a02af None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:34.292579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be141c8-e852-4f98-be0d-6007f27a02af None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:34.294660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 829/1669] 10.222.0.57 () {54 vars in 912 bytes} [Wed Sep 7 13:19:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:19:34.311634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:34.312799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:34.314719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:34.375299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:34.379711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:34.413622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 841/1670] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:19:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:34.427083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be141c8-e852-4f98-be0d-6007f27a02af None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:34.448276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be141c8-e852-4f98-be0d-6007f27a02af None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:34.454396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c2f77-d30b-43ba-ab00-f6de7af60c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:34.455361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c2f77-d30b-43ba-ab00-f6de7af60c55 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:34.455830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c2f77-d30b-43ba-ab00-f6de7af60c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:34.456606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c2f77-d30b-43ba-ab00-f6de7af60c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:34.467060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c2f77-d30b-43ba-ab00-f6de7af60c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:34.469217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c2f77-d30b-43ba-ab00-f6de7af60c55 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:34.492703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 830/1671] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:35.370051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:35.619542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189e6a-fec3-43ed-9086-5a15727bbb3b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:35.656460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:35.657131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:35.657412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:35.657685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] PATH_INFO: `/v3/users/75d0370ea29d439c929d510fbd6bce5e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:35.659675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d0370ea29d439c929d510fbd6bce5e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:35.668320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:36.040469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d0370ea29d439c929d510fbd6bce5e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:36.042879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d0370ea29d439c929d510fbd6bce5e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:36.077360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d0370ea29d439c929d510fbd6bce5e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:36.101535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d0370ea29d439c929d510fbd6bce5e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:36.106662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d0370ea29d439c929d510fbd6bce5e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:36.208373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 842/1672] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:35 2022] DELETE /identity/v3/users/75d0370ea29d439c929d510fbd6bce5e => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:36.209885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d98069-c995-4153-a705-1035a26f3f43 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:36.211052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d98069-c995-4153-a705-1035a26f3f43 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:36.211052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d98069-c995-4153-a705-1035a26f3f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:36.264443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c1d98069-c995-4153-a705-1035a26f3f43 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:36.272307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c1d98069-c995-4153-a705-1035a26f3f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:36.470774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 831/1673] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:36.481374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:36.482828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:36.588993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:36.701639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae839-de30-4192-bf75-88d1cde4178f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:36.715224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2a871-6b22-4f4d-96d3-cde746d69f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:36.715926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2a871-6b22-4f4d-96d3-cde746d69f9b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:36.716241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2a871-6b22-4f4d-96d3-cde746d69f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:36.716518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2a871-6b22-4f4d-96d3-cde746d69f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:36.738747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2a871-6b22-4f4d-96d3-cde746d69f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:36.740619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2a871-6b22-4f4d-96d3-cde746d69f9b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:36.753692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 843/1674] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:36.808162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:36.809275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:36.810349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:36.861224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] MFA Rules not processed for user `cb3e13c85e8545afab44389368eb91dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:36.863529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:36.903065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:37.010743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 832/1675] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:38.677531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:38.678028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:38.678325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:38.776972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:38.779703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:39.025770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 844/1676] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:39.577589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:39.579724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:39.947734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6a16d-72bd-4a90-8dc2-76ea89bce65c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:39.969679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa72f11-fca8-457a-b788-4581a781e805 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:39.973465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72f11-fca8-457a-b788-4581a781e805 service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:39.973769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72f11-fca8-457a-b788-4581a781e805 service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:39.974049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72f11-fca8-457a-b788-4581a781e805 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:40.048270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa72f11-fca8-457a-b788-4581a781e805 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:40.049906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa72f11-fca8-457a-b788-4581a781e805 service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:40.093157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 833/1677] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:19:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:19:40.220844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:40.222420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:40.256999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c48d-1d28-4b48-a549-a37863032880 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:40.277430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:40.278109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:40.278390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:40.278663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] PATH_INFO: `/v3/projects/3fca63d3c3914fd18e6013ca938906f8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:40.294050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fca63d3c3914fd18e6013ca938906f8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:40.295279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: WARNING py.warnings [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:19:40.295279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: warnings.warn(msg) Sep 07 13:19:40.295279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: Sep 07 13:19:40.305271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:40.607714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fca63d3c3914fd18e6013ca938906f8', 'request_id': 'req-1f58dd61-d39c-4fce-a359-8a08cc1bade9'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:40.658834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fca63d3c3914fd18e6013ca938906f8', 'request_id': 'req-1f58dd61-d39c-4fce-a359-8a08cc1bade9'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:40.673394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fca63d3c3914fd18e6013ca938906f8', 'request_id': 'req-1f58dd61-d39c-4fce-a359-8a08cc1bade9'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:40.818089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] The token cache is being invalidate because project 3fca63d3c3914fd18e6013ca938906f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:40.818707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:40.821818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1f58dd61-d39c-4fce-a359-8a08cc1bade9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:40.828801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 845/1678] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:40 2022] DELETE /identity/v3/projects/3fca63d3c3914fd18e6013ca938906f8 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:40.830347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a50714-1366-4f82-89c7-d90c633ca84b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:40.830835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a50714-1366-4f82-89c7-d90c633ca84b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:40.830942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a50714-1366-4f82-89c7-d90c633ca84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:40.908984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:40.909316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:40.909591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:40.938245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-09a50714-1366-4f82-89c7-d90c633ca84b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:40.948012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-09a50714-1366-4f82-89c7-d90c633ca84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:40.976936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] MFA Rules not processed for user `c650fb007aad4a42ae13906b127bd6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:40.979521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:41.043742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:41.141887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 834/1679] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:41.148642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:41.154349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 846/1680] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:41.155123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:41.155549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:41.250492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:41.255224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:41.285057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 835/1681] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:41.292365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:41.319305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac686b-4f90-4fcb-b238-e0efcc511c1b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:41.331663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:41.332661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:41.333020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:41.333627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:41.337739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:41.338375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:41.340470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:41.430745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:41.451697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7188-cf0b-4497-add7-604e91fb9117 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:41.453404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 847/1682] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:19:41.465097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:41.466604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:41.474766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:41.480117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:41.481651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:41.488801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:41.587863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:41.731801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 836/1683] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:41 2022] POST /identity/v3/projects => generated 405 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:19:41.735420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:41.753794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701579d0-16cb-4dd3-8ee8-44a7a84540c7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:42.022363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:42.023405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:42.023837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:42.024307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:42.025134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:42.028124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:42.311130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 848/1684] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:41 2022] POST /identity/v3/users => generated 303 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:19:42.315201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:42.335309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f22d6-6116-4ddc-b4c9-6a59e8fc9cb5 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:42.348514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:42.349182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:42.349454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:42.349813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:42.350451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:42.352808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:42.388663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 837/1685] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:42.390460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:42.412203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdea81-6ee0-4e3e-9672-275f98e1d55d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:42.420637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d01d0-b315-467b-80b9-1e1a3b9faaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:42.422149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d01d0-b315-467b-80b9-1e1a3b9faaae admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:42.423066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d01d0-b315-467b-80b9-1e1a3b9faaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:42.426853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d01d0-b315-467b-80b9-1e1a3b9faaae admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:42.430026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d01d0-b315-467b-80b9-1e1a3b9faaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:42.434654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d01d0-b315-467b-80b9-1e1a3b9faaae admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:42.456576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 849/1686] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:42.457940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:42.478512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ace5c-fd23-4ab1-a431-ddcdec3832a2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:42.517301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:42.518008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:42.518288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:42.518563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] PATH_INFO: `/v3/projects/3a671bd55b4f4669a2f1fad8b1af012c/users/a96b4f0a7932416ca8084626b00b8c24/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:42.573112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a671bd55b4f4669a2f1fad8b1af012c, user_id=a96b4f0a7932416ca8084626b00b8c24, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:42.576149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:42.696147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 838/1687] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:42 2022] PUT /identity/v3/projects/3a671bd55b4f4669a2f1fad8b1af012c/users/a96b4f0a7932416ca8084626b00b8c24/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:42.698401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0004fae-4755-4f68-bb10-e31dbd5a85a9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:42.698401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0004fae-4755-4f68-bb10-e31dbd5a85a9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:42.698705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0004fae-4755-4f68-bb10-e31dbd5a85a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:42.804910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e0004fae-4755-4f68-bb10-e31dbd5a85a9 None None] MFA Rules not processed for user `a96b4f0a7932416ca8084626b00b8c24`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:42.806341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e0004fae-4755-4f68-bb10-e31dbd5a85a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:43.167270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 850/1688] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:43.170824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:43.526625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4bbfa-3c94-4ef3-9fad-1d6a6c1d4bc6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:43.563247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:43.563247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:43.563247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:43.564510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:43.566609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:43.567036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:43.567434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:43.569251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:43.588331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:43.652466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:43.674740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:43.757664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:43.850195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 839/1689] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:43 2022] POST /identity/v3/projects => generated 403 bytes in 677 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:43.852867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:43.898987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 851/1690] 10.222.0.77 () {58 vars in 1015 bytes} [Wed Sep 7 13:19:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:44.062791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05722087-ce7d-4800-a363-49acd947c20d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:44.081456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:44.082567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:44.083005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:44.083642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:44.084553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:44.100991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:44.234370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 840/1691] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:43 2022] POST /identity/v3/users => generated 308 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:44.238901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:44.294396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee2151-e7a8-4fa1-923d-bf047edcb387 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:44.320404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:44.327668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:44.327668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:44.339345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:44.341425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:44.370727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:44.428781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:44.430765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:44.457299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 852/1692] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:44.458278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:44.500677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:44.695359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:44.745294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8793c47-783c-4a7c-a057-f7bdef3b4bad admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:44.754437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:44.755371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:44.755951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:44.756443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:44.794812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:44.799949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:44.809414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f22f1-ac21-48de-b3ac-53c94e0b9b69 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:44.816516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:44.818084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:44.818638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:44.819302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:44.831530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:44.833267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:44.845889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 853/1693] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:44.849279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:44.869548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af078231-8225-4e9e-9a1b-84ddcec0d4dd service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:44.874390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:44.875493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:44.875934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:44.876392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] PATH_INFO: `/v3/projects/54f4592a29174328b269ff608f4df02b/users/5b39edded08941699de42a28b58d4040/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:44.896335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 841/1694] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:44.901560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f4592a29174328b269ff608f4df02b, user_id=5b39edded08941699de42a28b58d4040, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:44.907625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:45.023728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 854/1695] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:44 2022] PUT /identity/v3/projects/54f4592a29174328b269ff608f4df02b/users/5b39edded08941699de42a28b58d4040/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:45.027735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:45.057536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24abe5f-2d20-436c-8860-8f5e2456de06 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:45.210742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb3b61-0076-499b-8d4c-ac3b5e63bd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:45.211929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb3b61-0076-499b-8d4c-ac3b5e63bd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:45.212409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb3b61-0076-499b-8d4c-ac3b5e63bd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:45.213088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb3b61-0076-499b-8d4c-ac3b5e63bd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:45.214034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb3b61-0076-499b-8d4c-ac3b5e63bd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:45.229391 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb3b61-0076-499b-8d4c-ac3b5e63bd66 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:45.284228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 842/1696] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:45.289839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:45.311344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba6b4c-80d8-4c99-b7f0-2e1966604e72 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:45.352501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:45.353505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:45.354409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:45.357930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] PATH_INFO: `/v3/projects/54f4592a29174328b269ff608f4df02b/users/5b39edded08941699de42a28b58d4040/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:45.359896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f4592a29174328b269ff608f4df02b, user_id=5b39edded08941699de42a28b58d4040, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:45.363156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:45.382213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 855/1697] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:45 2022] PUT /identity/v3/projects/54f4592a29174328b269ff608f4df02b/users/5b39edded08941699de42a28b58d4040/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:19:45.400386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:45.400779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:45.401069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:45.469492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] MFA Rules not processed for user `5b39edded08941699de42a28b58d4040`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:45.477113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:45.807854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 843/1698] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:45.936226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:45.938696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:46.167232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd1fb7-3b88-4345-8a88-d7fef42c7fc1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:46.167232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7987eb2-91eb-4dd3-9e35-58525ba87582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:46.167232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7987eb2-91eb-4dd3-9e35-58525ba87582 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:46.167232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7987eb2-91eb-4dd3-9e35-58525ba87582 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:46.167673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7987eb2-91eb-4dd3-9e35-58525ba87582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:46.202222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7987eb2-91eb-4dd3-9e35-58525ba87582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:46.203975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7987eb2-91eb-4dd3-9e35-58525ba87582 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:46.255613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 856/1699] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:45 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:46.635822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:46.925505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2a5b9-8fe0-4e92-9285-91890cba2699 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:46.941297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:46.942567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:46.943060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:46.943590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] PATH_INFO: `/v3/users/a96b4f0a7932416ca8084626b00b8c24` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:46.959976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96b4f0a7932416ca8084626b00b8c24)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:46.965362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: WARNING py.warnings [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 07 13:19:46.965362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: warnings.warn(msg) Sep 07 13:19:46.965362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: Sep 07 13:19:46.968531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:46.976305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:47.320242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96b4f0a7932416ca8084626b00b8c24'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:47.321101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96b4f0a7932416ca8084626b00b8c24'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:47.323605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96b4f0a7932416ca8084626b00b8c24'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:47.348034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96b4f0a7932416ca8084626b00b8c24'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:47.414549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96b4f0a7932416ca8084626b00b8c24'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:47.535836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 844/1700] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:46 2022] DELETE /identity/v3/users/a96b4f0a7932416ca8084626b00b8c24 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:47.541331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:47.541817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:47.541817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:47.580246 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:47.581447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:47.677736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:47.680440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:47.682205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:47.773980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 857/1701] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:47.863412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abe65b-a0e4-4041-890b-6a48c745d06f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:47.885156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:47.886368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:47.886997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:47.887492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] PATH_INFO: `/v3/users/119010358acb4b1aa4b49f70a06a2007` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:47.889132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119010358acb4b1aa4b49f70a06a2007)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:47.893071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:47.908527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:47.910016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:48.075967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037498-9e9f-4454-80ff-ce8ac3c22a52 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:48.094920 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5b686-22a4-4915-861f-4edf2e08cda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:48.095659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b686-22a4-4915-861f-4edf2e08cda2 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:48.095842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b686-22a4-4915-861f-4edf2e08cda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:48.096268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b686-22a4-4915-861f-4edf2e08cda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:48.125857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5b686-22a4-4915-861f-4edf2e08cda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:48.127710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5b686-22a4-4915-861f-4edf2e08cda2 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:48.145296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 858/1702] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:48.213277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119010358acb4b1aa4b49f70a06a2007'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:48.214597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119010358acb4b1aa4b49f70a06a2007'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:48.216384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119010358acb4b1aa4b49f70a06a2007'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:48.240800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119010358acb4b1aa4b49f70a06a2007'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:48.301981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119010358acb4b1aa4b49f70a06a2007'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:48.431890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:48.447800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ae40d-36b7-4777-ac28-6e1661740629 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:48.448136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ae40d-36b7-4777-ac28-6e1661740629 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:48.448579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ae40d-36b7-4777-ac28-6e1661740629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:48.454147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 845/1703] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:47 2022] DELETE /identity/v3/users/119010358acb4b1aa4b49f70a06a2007 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:48.497385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-111ae40d-36b7-4777-ac28-6e1661740629 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:48.498971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-111ae40d-36b7-4777-ac28-6e1661740629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:48.671077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 859/1704] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:49.127789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:49.129846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:49.254111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3cc7-78ee-44ce-8aca-1c350009c086 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:49.272139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8283d-fe1a-4a88-9c57-409e9a9a25f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:49.272139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8283d-fe1a-4a88-9c57-409e9a9a25f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:49.272139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8283d-fe1a-4a88-9c57-409e9a9a25f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:49.272139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8283d-fe1a-4a88-9c57-409e9a9a25f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:49.290518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8283d-fe1a-4a88-9c57-409e9a9a25f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:49.292052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8283d-fe1a-4a88-9c57-409e9a9a25f7 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:49.329704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 846/1705] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:49.716944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fbee-0479-4790-b8ec-811b9f32faf6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:49.719092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fbee-0479-4790-b8ec-811b9f32faf6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:49.723089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fbee-0479-4790-b8ec-811b9f32faf6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:49.732181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 860/1706] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:19:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:19:49.743065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:49.743558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:49.743974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:49.801623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:49.805010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:49.984919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 847/1707] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:50.374744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4fbee-0479-4790-b8ec-811b9f32faf6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:50.377840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-05a4fbee-0479-4790-b8ec-811b9f32faf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:50.422524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4fbee-0479-4790-b8ec-811b9f32faf6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:50.430966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:50.431902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:50.432622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:50.433031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] PATH_INFO: `/v3/users/864b75daee8340068c331b31fa4f1b73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:50.434505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=864b75daee8340068c331b31fa4f1b73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:50.451248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:50.580932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:50.582375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:50.607575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df3bd6-8909-4e14-9767-55158afd3d1b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:50.614210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac720d2c-f84d-4c77-aa39-4863eba1be51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:50.615007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac720d2c-f84d-4c77-aa39-4863eba1be51 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:50.615286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac720d2c-f84d-4c77-aa39-4863eba1be51 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:50.615558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac720d2c-f84d-4c77-aa39-4863eba1be51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:50.627346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac720d2c-f84d-4c77-aa39-4863eba1be51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:50.629444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac720d2c-f84d-4c77-aa39-4863eba1be51 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:50.646061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 848/1708] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:50.716017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864b75daee8340068c331b31fa4f1b73'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:50.716744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864b75daee8340068c331b31fa4f1b73'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:50.733318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864b75daee8340068c331b31fa4f1b73'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:50.745609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:50.760823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864b75daee8340068c331b31fa4f1b73'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:50.761789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864b75daee8340068c331b31fa4f1b73'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:50.817692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 861/1709] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:50 2022] DELETE /identity/v3/users/864b75daee8340068c331b31fa4f1b73 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:50.825039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:50.828752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:50.829843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:50.859605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:50.868749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:51.041221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 849/1710] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:51.066635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:51.068383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:51.069096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:51.074286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:51.102620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5082d-6e8a-4b11-9f0a-5ee679550809 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:51.113120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:51.114807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:51.117211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:51.117897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] PATH_INFO: `/v3/projects/3a671bd55b4f4669a2f1fad8b1af012c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:51.123464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a671bd55b4f4669a2f1fad8b1af012c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:51.129989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:51.170638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:51.176126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46310b91-4773-4853-bcd5-adfd0a475e31 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:51.208735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:51.215603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:51.215994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:51.217139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:51.257775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:51.269589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:51.298781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 862/1711] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:19:51.340048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a671bd55b4f4669a2f1fad8b1af012c', 'request_id': 'req-85594730-bcf7-4fd3-82c2-65705b7e5ca7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.384266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a671bd55b4f4669a2f1fad8b1af012c', 'request_id': 'req-85594730-bcf7-4fd3-82c2-65705b7e5ca7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.392607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:51.394494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:51.404634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a671bd55b4f4669a2f1fad8b1af012c', 'request_id': 'req-85594730-bcf7-4fd3-82c2-65705b7e5ca7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.425990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e918fd-d2cc-40fa-861e-ea8670bf1a93 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:51.521503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] The token cache is being invalidate because project 3a671bd55b4f4669a2f1fad8b1af012c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:51.521845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.525175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.532217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 850/1712] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:51 2022] DELETE /identity/v3/projects/3a671bd55b4f4669a2f1fad8b1af012c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:19:51.541166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:51.543561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:51.729987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:51.733583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:51.734541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:51.735675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] PATH_INFO: `/v3/projects/66becf2b68cd42b59741f8db84430bd4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:51.738747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85594730-bcf7-4fd3-82c2-65705b7e5ca7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:51.741897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66becf2b68cd42b59741f8db84430bd4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:51.748506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:51.754317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:51.756729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:51.758454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:51.758454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] PATH_INFO: `/v3/users/5b39edded08941699de42a28b58d4040` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:51.766335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b39edded08941699de42a28b58d4040)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:51.773956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:51.955064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b39edded08941699de42a28b58d4040'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.956171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b39edded08941699de42a28b58d4040'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.967064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b39edded08941699de42a28b58d4040'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.969126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66becf2b68cd42b59741f8db84430bd4', 'request_id': 'req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.970966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b39edded08941699de42a28b58d4040'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.982101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66becf2b68cd42b59741f8db84430bd4', 'request_id': 'req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.993661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b39edded08941699de42a28b58d4040'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:51.999335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66becf2b68cd42b59741f8db84430bd4', 'request_id': 'req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.114646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 851/1713] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:51 2022] DELETE /identity/v3/users/5b39edded08941699de42a28b58d4040 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:52.169162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] The token cache is being invalidate because project 66becf2b68cd42b59741f8db84430bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:52.169741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.172708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1c8945ee-62fa-4949-a10a-8e3bd7c19ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.174736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 863/1714] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:51 2022] DELETE /identity/v3/projects/66becf2b68cd42b59741f8db84430bd4 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:52.179030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:52.180536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:52.237931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:52.300537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e96ad6-1c8b-4589-9664-95b1a19fe9fe admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:52.307107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:52.307751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:52.308118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:52.308611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] PATH_INFO: `/v3/users/3e5697b70fa14659be98cb8b6344bedb` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:52.309649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5697b70fa14659be98cb8b6344bedb)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:52.311715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:52.577425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5697b70fa14659be98cb8b6344bedb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.578243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5697b70fa14659be98cb8b6344bedb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.578929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5697b70fa14659be98cb8b6344bedb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.593706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5697b70fa14659be98cb8b6344bedb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.618215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-12e68eea-3e3c-45a8-995c-b21280c1bd1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5697b70fa14659be98cb8b6344bedb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:52.717740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 852/1715] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:52 2022] DELETE /identity/v3/users/3e5697b70fa14659be98cb8b6344bedb => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:52.749757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdd73a-9b76-4a17-b7f5-0fdd98b051a6 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:52.750798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdd73a-9b76-4a17-b7f5-0fdd98b051a6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:52.751263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fdd73a-9b76-4a17-b7f5-0fdd98b051a6 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:52.752949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 864/1716] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:19:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:19:52.790401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:52.790887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:52.790887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:52.836529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:52.838458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:53.027100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 853/1717] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:19:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:53.847186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdd73a-9b76-4a17-b7f5-0fdd98b051a6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:53.852469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a4fdd73a-9b76-4a17-b7f5-0fdd98b051a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:53.908909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fdd73a-9b76-4a17-b7f5-0fdd98b051a6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:53.920742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:53.922518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:53.923099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:53.923520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:53.942628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:53.958380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:53.977133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 865/1718] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:53.999933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:54.002367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:54.118623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:54.168323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b376da-8f3d-420f-8da8-b3d2759f1b10 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:54.173804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:54.174611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:54.174891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:54.176748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] PATH_INFO: `/v3/projects/9d4081c8b6f84e0cb3122138a4dfe2a8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:54.176748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4081c8b6f84e0cb3122138a4dfe2a8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:54.178454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:54.520647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4081c8b6f84e0cb3122138a4dfe2a8', 'request_id': 'req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:54.533123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4081c8b6f84e0cb3122138a4dfe2a8', 'request_id': 'req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:54.541798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4081c8b6f84e0cb3122138a4dfe2a8', 'request_id': 'req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:54.727847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:54.730251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:54.748890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:54.758620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] The token cache is being invalidate because project 9d4081c8b6f84e0cb3122138a4dfe2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:54.758620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:54.758620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:54.758620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 854/1719] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:53 2022] DELETE /identity/v3/projects/9d4081c8b6f84e0cb3122138a4dfe2a8 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:54.759920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:54.761580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e7d7-e65f-4c1d-b2c6-94b2bbd28ace service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:54.763456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:54.886613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:54.887294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:54.887495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:54.887784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] PATH_INFO: `/v3/projects/54f4592a29174328b269ff608f4df02b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:54.891368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f4592a29174328b269ff608f4df02b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:54.892259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d8ac3-c8a1-468a-bf16-b30d88c0b9e4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:54.893314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:54.902292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:54.902955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:54.903647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:54.904023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] PATH_INFO: `/v3/users/67f1a6d0deaa41d3a6aaa7a4d9041541` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:54.905239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f1a6d0deaa41d3a6aaa7a4d9041541)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:54.908914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.108603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f1a6d0deaa41d3a6aaa7a4d9041541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.109270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f1a6d0deaa41d3a6aaa7a4d9041541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.109870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f1a6d0deaa41d3a6aaa7a4d9041541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.116965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f1a6d0deaa41d3a6aaa7a4d9041541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.123066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f4592a29174328b269ff608f4df02b', 'request_id': 'req-cf242191-c372-4d0e-8f90-f5c0bab8db0e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.129827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f1a6d0deaa41d3a6aaa7a4d9041541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.130015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f4592a29174328b269ff608f4df02b', 'request_id': 'req-cf242191-c372-4d0e-8f90-f5c0bab8db0e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.136586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f4592a29174328b269ff608f4df02b', 'request_id': 'req-cf242191-c372-4d0e-8f90-f5c0bab8db0e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.185188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 855/1720] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:54 2022] DELETE /identity/v3/users/67f1a6d0deaa41d3a6aaa7a4d9041541 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:55.186053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.187447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.261030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc10da-c1be-47ac-9393-c17d2002ed7f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.265949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.266694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.266967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.267237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] PATH_INFO: `/v3/projects/bc927b0e928d46a1ae0f4d08f8d195aa` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.268687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc927b0e928d46a1ae0f4d08f8d195aa)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.270459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.292008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] The token cache is being invalidate because project 54f4592a29174328b269ff608f4df02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:55.292595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.293702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cf242191-c372-4d0e-8f90-f5c0bab8db0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.297754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 866/1721] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:54 2022] DELETE /identity/v3/projects/54f4592a29174328b269ff608f4df02b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:19:55.304197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c565ec-d8a4-4166-96bd-ed909efae5c7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.305848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c565ec-d8a4-4166-96bd-ed909efae5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.305848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c565ec-d8a4-4166-96bd-ed909efae5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.325623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c8c565ec-d8a4-4166-96bd-ed909efae5c7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:55.327100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c8c565ec-d8a4-4166-96bd-ed909efae5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.335190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 867/1722] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:55.346479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.346733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.347174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.375042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:55.376352 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.407102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc927b0e928d46a1ae0f4d08f8d195aa', 'request_id': 'req-a2fa6527-d722-4c56-ae76-bf9dadd8958d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.417856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc927b0e928d46a1ae0f4d08f8d195aa', 'request_id': 'req-a2fa6527-d722-4c56-ae76-bf9dadd8958d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.425268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc927b0e928d46a1ae0f4d08f8d195aa', 'request_id': 'req-a2fa6527-d722-4c56-ae76-bf9dadd8958d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.465790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:55.484239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 868/1723] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:55.486544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.496178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d063fc8-8d7f-4bee-b617-eef933755dfd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.500904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.501510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.501785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.502055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.502834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:55.503050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.504707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.523232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] The token cache is being invalidate because project bc927b0e928d46a1ae0f4d08f8d195aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:55.523616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.524514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a2fa6527-d722-4c56-ae76-bf9dadd8958d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:55.529058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 869/1724] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:55.529313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 856/1725] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:55 2022] DELETE /identity/v3/projects/bc927b0e928d46a1ae0f4d08f8d195aa => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:55.530132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.532242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.534062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc3b85-1d54-48e2-9b13-12b12d48461f None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.535014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc3b85-1d54-48e2-9b13-12b12d48461f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.535014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc3b85-1d54-48e2-9b13-12b12d48461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.547404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93806e-b6d9-4d52-a65f-be0932330f8a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.554447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.555393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.556049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.557638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.559046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.562064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.572324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-76dc3b85-1d54-48e2-9b13-12b12d48461f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:55.573455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-76dc3b85-1d54-48e2-9b13-12b12d48461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.584012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 857/1726] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:55.592438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.592828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.593192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.617165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:55.618396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.626898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 858/1727] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:55.631192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.641289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2d5df-01dc-4e88-abd0-6f4243203a5b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.646080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.646689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.647484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.647484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.648537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:55.648828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.650424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.669851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 859/1728] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:19:55.675689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.681450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 870/1729] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/projects => generated 399 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:55.685236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.686946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e1881-6856-499c-b8c6-3910b2f71649 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.772252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.773570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.773917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.774259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.774966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.778219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.793976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5a2b3-35bd-4eb1-b143-f2dbcb9989d9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.800801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.801423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.802122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.802122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.803065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.804835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.876920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 860/1730] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:55.877943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.879514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:55.923599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 871/1731] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:55.927981 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:55.945202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea4457-6cec-4ddf-9ce0-c36d1da46943 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.945416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a34a4-be25-40c5-aa49-33b3eb47e66a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:55.949582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.950070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:55.950405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.950754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.950860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:55.951028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:55.951217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.951305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] PATH_INFO: `/v3/projects/38a2ca2e2f444b60b3bcda9c3d554a32` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:55.952023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.952453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a2ca2e2f444b60b3bcda9c3d554a32)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:55.954198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:55.954472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.050075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 872/1732] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:55 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:56.051097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.076649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef113e3-e51a-4dee-899c-03d353bf3542 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.085076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a2ca2e2f444b60b3bcda9c3d554a32', 'request_id': 'req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:56.097166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a2ca2e2f444b60b3bcda9c3d554a32', 'request_id': 'req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:56.106135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a2ca2e2f444b60b3bcda9c3d554a32', 'request_id': 'req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:56.153210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:56.169694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.170315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.170593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.170862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.171508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.173143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.188749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 873/1733] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:56.188749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.191069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] The token cache is being invalidate because project 38a2ca2e2f444b60b3bcda9c3d554a32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:19:56.191547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:56.192182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:19:56.193933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 861/1734] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:19:55 2022] DELETE /identity/v3/projects/38a2ca2e2f444b60b3bcda9c3d554a32 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:56.195411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.196865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:56.202961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cfef80-f3c6-4657-8cac-8bfe50c15c69 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.210341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f82da-4ceb-4ff7-8eb0-58ed7eec7e70 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.211520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2bb48-597b-44aa-88c0-8260592ef1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.212341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2bb48-597b-44aa-88c0-8260592ef1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.212684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2bb48-597b-44aa-88c0-8260592ef1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.213786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2bb48-597b-44aa-88c0-8260592ef1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.214652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2bb48-597b-44aa-88c0-8260592ef1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.216046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.216880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.217129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.217453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.217713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2bb48-597b-44aa-88c0-8260592ef1e6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.218109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.219711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.229747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 874/1735] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:56.231262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.231603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.231979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.239448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 862/1736] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:56.239448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.239448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:56.251165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a395f-affb-416c-818b-8d4f262b369e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.252759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:56.254054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:56.257453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa397b3-5001-42c7-91b7-7e983c2f0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.258289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa397b3-5001-42c7-91b7-7e983c2f0539 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.258645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa397b3-5001-42c7-91b7-7e983c2f0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.258992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa397b3-5001-42c7-91b7-7e983c2f0539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.259708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa397b3-5001-42c7-91b7-7e983c2f0539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.261415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa397b3-5001-42c7-91b7-7e983c2f0539 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.265318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 875/1737] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:56.265318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.275131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c21962-1aeb-454e-b021-d4209a6d4b80 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.277600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 863/1738] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:56.280248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.281074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.281451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.281819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] PATH_INFO: `/v3/projects/273cf3a062f04129819133e5d3d939f0/users/dd84114e57364a589aa82e6aa538f24a/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.281995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.282520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.282520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.300850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273cf3a062f04129819133e5d3d939f0, user_id=dd84114e57364a589aa82e6aa538f24a, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.304167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.304689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:56.306042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:56.315586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 864/1739] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:56.315586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.325798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1579ec-9f36-414c-ab45-66d84bf59c6e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.330449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f99f89-5cda-4b11-bec1-6dc1a50b5f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.331088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99f89-5cda-4b11-bec1-6dc1a50b5f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.331390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99f89-5cda-4b11-bec1-6dc1a50b5f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.331652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f99f89-5cda-4b11-bec1-6dc1a50b5f02 admin admin] PATH_INFO: `/v3/projects/32f9416a2a454d61b7ce1c9984f28769/users/f1477a0c0f7f4eba88e171bfb7c7ee20/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.345687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f99f89-5cda-4b11-bec1-6dc1a50b5f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f9416a2a454d61b7ce1c9984f28769, user_id=f1477a0c0f7f4eba88e171bfb7c7ee20, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.348559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f99f89-5cda-4b11-bec1-6dc1a50b5f02 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.406183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 876/1740] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:56 2022] PUT /identity/v3/projects/273cf3a062f04129819133e5d3d939f0/users/dd84114e57364a589aa82e6aa538f24a/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:56.406183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.451559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 865/1741] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:56 2022] PUT /identity/v3/projects/32f9416a2a454d61b7ce1c9984f28769/users/f1477a0c0f7f4eba88e171bfb7c7ee20/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:56.453544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ec3c-2107-46d4-b746-3a3f9f9be3f5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.454083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ec3c-2107-46d4-b746-3a3f9f9be3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.459436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9ec3c-2107-46d4-b746-3a3f9f9be3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.490541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-2ce9ec3c-2107-46d4-b746-3a3f9f9be3f5 None None] MFA Rules not processed for user `dd84114e57364a589aa82e6aa538f24a`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:56.493247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2ce9ec3c-2107-46d4-b746-3a3f9f9be3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:56.535331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edab052-1d6f-4c2c-8585-f037c10c2501 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.598640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 866/1742] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:56.601520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.601802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.602078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.638851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.639972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.640285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.640841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.641554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:19:56.641861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.642154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] MFA Rules not processed for user `f1477a0c0f7f4eba88e171bfb7c7ee20`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:56.643525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:56.643641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.677183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 877/1743] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:19:56.677183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.699386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39e43e-2fdb-4208-9ba2-6f53a59e9079 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.699386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.699386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.699386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.699697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.699697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.701268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.748485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 867/1744] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:56.749390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.768676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbed8e-36b3-4f08-a7c3-c5c546140cb1 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.778599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.779229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.779506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.779775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.780731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.782640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.809107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 878/1745] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/projects => generated 401 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:56.810151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.887899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2268f2b-dec7-48e3-af4d-eb4616fe0378 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.895716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 868/1746] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:56.895716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.896800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.898527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.898887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.899298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.900011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.902834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.964038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20f243-21f1-4570-94e4-b91fbed91332 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:56.970124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:56.970818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:56.971029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:56.971292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:56.971917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:56.973847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:56.985942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 879/1747] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:56.986858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:56.990813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:57.048777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39612f-1632-46d2-8569-789ab04d1cfc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.054151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.055504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.055504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.055504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.056393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.058434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.098325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 869/1748] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/users => generated 307 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:57.099131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.109370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b1b3e-1283-4146-aab3-a29589226640 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.113976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.114582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.114852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.115131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.115754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.117736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.178405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 880/1749] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:56 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:57.179483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.189123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3afae-e7d2-42f6-aab7-59bb9ee96bc8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.193680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.194811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.195083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.195348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.195974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.197590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.207297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 881/1750] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:57.208191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.217115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 870/1751] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:57 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:57.217115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.220034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16084f9-c260-423c-b5bf-478361be2505 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.224001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.224657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.224935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.225204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.225847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.226265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b711c4-4039-4b81-929b-2f78ed28be4b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.227426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.231206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.231851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.232151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.232421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] PATH_INFO: `/v3/projects/9cf8791af2bb4ddca300562f54b150a1/users/79f1073e79aa43c784d852e4eb7ec2df/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.240926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 882/1752] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:57.247085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.249168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf8791af2bb4ddca300562f54b150a1, user_id=79f1073e79aa43c784d852e4eb7ec2df, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.251518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2fb5f-162d-4164-bf7d-934815e00a96 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.251848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.256231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.257347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.257641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.257893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.258531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.260101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.270393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 883/1753] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:57.271176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.280970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec7a51-4298-4d9a-b4c2-b2744617b2b2 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.285521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.286086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.286624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.286893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.287510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.289136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.304431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 884/1754] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:57.304431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.308756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ee2cb-5d60-4835-aeed-d47d72fc2cb9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.313292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.313910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.314189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.314458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] PATH_INFO: `/v3/projects/4626bab06bcf48b38825d536a9a21370/users/4f684519bca34c5abcbb77e369c89a13/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.327984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 871/1755] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:57 2022] PUT /identity/v3/projects/9cf8791af2bb4ddca300562f54b150a1/users/79f1073e79aa43c784d852e4eb7ec2df/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:57.330976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4626bab06bcf48b38825d536a9a21370, user_id=4f684519bca34c5abcbb77e369c89a13, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.331832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.336463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.402575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec242e-3fb4-4ef4-b4db-97cd4928b2d0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.408335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.409063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.409346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.409623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] PATH_INFO: `/v3/projects/089a3f03633a49b895bb66f9469ebca5/users/5568738b1e13456a9cd591f15bf39824/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.414533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 885/1756] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:57 2022] PUT /identity/v3/projects/4626bab06bcf48b38825d536a9a21370/users/4f684519bca34c5abcbb77e369c89a13/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:57.415758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.426110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=089a3f03633a49b895bb66f9469ebca5, user_id=5568738b1e13456a9cd591f15bf39824, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.429725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.481612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa12f54-5e60-45be-9037-51b46190a3d3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.486722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.487364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.487654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.487928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.489809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.490668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.496067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:57.504440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 886/1757] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:57.508511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.518794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3797477-018b-499d-ab68-5909d5b6a1c7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.529331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 872/1758] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:57 2022] PUT /identity/v3/projects/089a3f03633a49b895bb66f9469ebca5/users/5568738b1e13456a9cd591f15bf39824/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:57.529331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.531895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee2656-2308-45e4-a09a-c89c57c4eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.532602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2656-2308-45e4-a09a-c89c57c4eadb admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.532890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2656-2308-45e4-a09a-c89c57c4eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.533143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee2656-2308-45e4-a09a-c89c57c4eadb admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.533783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee2656-2308-45e4-a09a-c89c57c4eadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.535377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee2656-2308-45e4-a09a-c89c57c4eadb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.551140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 887/1759] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:57.558044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc710-9a3a-44f7-812f-0a35b9d8e69e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.558044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc710-9a3a-44f7-812f-0a35b9d8e69e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.558044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dc710-9a3a-44f7-812f-0a35b9d8e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.602895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-230dc710-9a3a-44f7-812f-0a35b9d8e69e None None] MFA Rules not processed for user `5568738b1e13456a9cd591f15bf39824`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:57.604169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-230dc710-9a3a-44f7-812f-0a35b9d8e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:57.630964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58832f-00f3-42c6-b88f-448405bb6026 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.636438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.637127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.637408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.637687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] PATH_INFO: `/v3/projects/9cf8791af2bb4ddca300562f54b150a1/users/79f1073e79aa43c784d852e4eb7ec2df/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.639921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf8791af2bb4ddca300562f54b150a1, user_id=79f1073e79aa43c784d852e4eb7ec2df, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.642572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.656733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 873/1760] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:57 2022] PUT /identity/v3/projects/9cf8791af2bb4ddca300562f54b150a1/users/79f1073e79aa43c784d852e4eb7ec2df/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:57.659576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.711949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 888/1761] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:57.714367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160418a9-8d35-4928-9502-40d578975fe2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.715279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160418a9-8d35-4928-9502-40d578975fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.715661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160418a9-8d35-4928-9502-40d578975fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.759385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-160418a9-8d35-4928-9502-40d578975fe2 None None] MFA Rules not processed for user `79f1073e79aa43c784d852e4eb7ec2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:57.761144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-160418a9-8d35-4928-9502-40d578975fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:57.804034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c9ffc-4b87-48dd-8717-e74ecf76b5e9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.809632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.810771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.810897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.811142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] PATH_INFO: `/v3/projects/4626bab06bcf48b38825d536a9a21370/users/4f684519bca34c5abcbb77e369c89a13/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.813616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4626bab06bcf48b38825d536a9a21370, user_id=4f684519bca34c5abcbb77e369c89a13, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.816606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:57.830117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:57.843483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 874/1762] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:57 2022] PUT /identity/v3/projects/4626bab06bcf48b38825d536a9a21370/users/4f684519bca34c5abcbb77e369c89a13/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:19:57.844124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:57.902257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 889/1763] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:57.904406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.904701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.905022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.950205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:57.953036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] MFA Rules not processed for user `4f684519bca34c5abcbb77e369c89a13`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:57.954725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:57.964620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e4ac0-27cf-4f21-abc6-587dd4ca1755 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:57.971067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:57.971876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:57.972573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:57.973128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:57.973862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:57.976170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.031565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 890/1764] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:19:58.032486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.033838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:58.094697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bba67a-4a2c-433c-a558-90819472a683 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.100179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.103185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.103185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.103185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.103425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 875/1765] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:19:57 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:58.104262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.114139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:58.180357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.181798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.192159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 891/1766] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:58.193115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.202401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a6fde-572b-4d0d-ab28-aa3bae7a343c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.204228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac385793-ffc3-425e-a574-8d7631028289 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.207747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.208759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.209209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.209636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.292496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.293956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.297964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.297964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.304627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.304627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.304627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.304627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.305639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 876/1767] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:58.413741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 892/1768] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:19:58 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:19:58.417618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.429107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573d514-8d26-4e9b-9008-a4ababf4b5eb service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.433827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.434435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.434710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.435267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.435677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.437293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.448295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 877/1769] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:58.455687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.466332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742e35c-86c5-45c8-8fad-c50140eaaccb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.470966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.471625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.471901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.472204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] PATH_INFO: `/v3/projects/82aefb9a2a634b119f01a034e599c4fb/users/48b040bcd85c4d108283b9a23c7f8923/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.477759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:58.490862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=82aefb9a2a634b119f01a034e599c4fb, user_id=48b040bcd85c4d108283b9a23c7f8923, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.493840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.502102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.512726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce83ba-17cd-4e7b-85fd-1d97f2a3bb8c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.516697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.517356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.517658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.517928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.576010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.577693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.587215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 878/1770] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:19:58.608318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 893/1771] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:58 2022] PUT /identity/v3/projects/82aefb9a2a634b119f01a034e599c4fb/users/48b040bcd85c4d108283b9a23c7f8923/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:19:58.608475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.619243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa3d2d-67a6-4f23-b63e-e7ad53182933 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.628974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:58.646617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.716920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.718128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.718694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.719334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.720023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.721769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.722737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f5ee-12e4-4c79-a12f-6d0b9b20ef2d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.728452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.729193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.729618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.730450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.736555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 879/1772] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:19:58.740160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:58.756287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0796ba-2852-4cda-9f52-2f1009b953ea admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:58.763143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10aab6-ac20-41d1-99b4-e425df28fa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:58.764111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10aab6-ac20-41d1-99b4-e425df28fa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.764819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10aab6-ac20-41d1-99b4-e425df28fa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.765170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10aab6-ac20-41d1-99b4-e425df28fa1e admin admin] PATH_INFO: `/v3/projects/82aefb9a2a634b119f01a034e599c4fb/users/48b040bcd85c4d108283b9a23c7f8923/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.768429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10aab6-ac20-41d1-99b4-e425df28fa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82aefb9a2a634b119f01a034e599c4fb, user_id=48b040bcd85c4d108283b9a23c7f8923, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.772974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10aab6-ac20-41d1-99b4-e425df28fa1e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.785522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 880/1773] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:19:58 2022] PUT /identity/v3/projects/82aefb9a2a634b119f01a034e599c4fb/users/48b040bcd85c4d108283b9a23c7f8923/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:19:58.797845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a087b32-96d8-4540-9376-29b806073937 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:58.800249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a087b32-96d8-4540-9376-29b806073937 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:58.800249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a087b32-96d8-4540-9376-29b806073937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:58.813776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:58.815209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:58.840478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 894/1774] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:58.841358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7a087b32-96d8-4540-9376-29b806073937 None None] MFA Rules not processed for user `48b040bcd85c4d108283b9a23c7f8923`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:19:58.841358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7a087b32-96d8-4540-9376-29b806073937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:19:58.859008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:58.900109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 881/1775] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:19:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:19:59.018643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:59.098617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:59.459207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:59.469522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5cb2-803b-4d57-a678-df700b6da316 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:59.528094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cccbc6-c318-488a-84c6-305bd78a742f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:59.529624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccbc6-c318-488a-84c6-305bd78a742f service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:59.530096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccbc6-c318-488a-84c6-305bd78a742f service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:59.530524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cccbc6-c318-488a-84c6-305bd78a742f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:59.543509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cccbc6-c318-488a-84c6-305bd78a742f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:59.545175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cccbc6-c318-488a-84c6-305bd78a742f service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:19:59.558729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 895/1776] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:19:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:19:59.590905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:19:59.684777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a087b32-96d8-4540-9376-29b806073937 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:19:59.783297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a087b32-96d8-4540-9376-29b806073937 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:19:59.791374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:19:59.792034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:19:59.792343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:19:59.792673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] PATH_INFO: `/v3/users/5568738b1e13456a9cd591f15bf39824` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:19:59.796516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5568738b1e13456a9cd591f15bf39824)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:19:59.798575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:00.879261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5568738b1e13456a9cd591f15bf39824'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:00.880604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5568738b1e13456a9cd591f15bf39824'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:00.881476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5568738b1e13456a9cd591f15bf39824'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:00.889345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5568738b1e13456a9cd591f15bf39824'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:00.903984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5568738b1e13456a9cd591f15bf39824'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:01.056062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 882/1777] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:19:59 2022] DELETE /identity/v3/users/5568738b1e13456a9cd591f15bf39824 => generated 0 bytes in 1369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:01.057844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:01.058314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:01.058409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:01.078271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:01.079501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:01.141959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 896/1778] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:01.152289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:01.153686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:01.197759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:01.213366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d824f-e00b-43cf-ba42-d7f7491db480 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:01.217252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:01.217900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:01.218180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:01.218458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:01.227432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:01.228898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:01.238293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 883/1779] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:01.642844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:01.647995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:01.657966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8640eef-2235-4ec0-a3cd-14870cd164ee None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:01.664528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:01.665181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:01.665452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:01.665870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] PATH_INFO: `/v3/projects/089a3f03633a49b895bb66f9469ebca5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:01.667114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=089a3f03633a49b895bb66f9469ebca5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:01.669387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:01.786581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:01.798235 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '089a3f03633a49b895bb66f9469ebca5', 'request_id': 'req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:01.806572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '089a3f03633a49b895bb66f9469ebca5', 'request_id': 'req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:01.828890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '089a3f03633a49b895bb66f9469ebca5', 'request_id': 'req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:01.991843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] The token cache is being invalidate because project 089a3f03633a49b895bb66f9469ebca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:01.992264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:01.992989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:01.994941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 897/1780] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:01 2022] DELETE /identity/v3/projects/089a3f03633a49b895bb66f9469ebca5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:01.998759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:02.009388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535859da-0313-46a1-ac3b-597a2287dc51 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:02.036795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:02.076665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:02.077303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:02.077581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:02.077858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] PATH_INFO: `/v3/users/48b040bcd85c4d108283b9a23c7f8923` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:02.079003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b040bcd85c4d108283b9a23c7f8923)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:02.081016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:02.314172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b040bcd85c4d108283b9a23c7f8923'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:02.315069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b040bcd85c4d108283b9a23c7f8923'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:02.315680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b040bcd85c4d108283b9a23c7f8923'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:02.323535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b040bcd85c4d108283b9a23c7f8923'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:02.335204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-feb350e4-0aef-487b-a52f-48da77238944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b040bcd85c4d108283b9a23c7f8923'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:02.415678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 884/1781] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:01 2022] DELETE /identity/v3/users/48b040bcd85c4d108283b9a23c7f8923 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:02.929367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:02.932651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:02.950916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7825b-8ebd-4a05-a022-b8c1e78f0332 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.022669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.023315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.023588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.023858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] PATH_INFO: `/v3/projects/82aefb9a2a634b119f01a034e599c4fb` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.029227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82aefb9a2a634b119f01a034e599c4fb)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.029227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.158345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82aefb9a2a634b119f01a034e599c4fb', 'request_id': 'req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:03.165800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82aefb9a2a634b119f01a034e599c4fb', 'request_id': 'req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:03.171776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82aefb9a2a634b119f01a034e599c4fb', 'request_id': 'req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:03.288706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] The token cache is being invalidate because project 82aefb9a2a634b119f01a034e599c4fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:03.289298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:03.290521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ea756a9d-3363-4ae5-a26a-1fac8b179d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:03.292390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 898/1782] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:02 2022] DELETE /identity/v3/projects/82aefb9a2a634b119f01a034e599c4fb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:03.297662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.298198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.298382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.319519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:03.320947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:03.392023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 885/1783] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:03.401089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.401371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.401642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.422910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:03.424294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:03.437295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 899/1784] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:03.438985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:03.450433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c9d0-7ec5-4586-8457-9237e7fb9128 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.455380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.456220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.456655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.456917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.457733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:03.458321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.460158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.480748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 886/1785] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:03.481743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:03.496923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8cb32-ed4a-4187-be8c-da30f94182f2 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.503252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.503989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.504555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.505429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.506539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.508879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.606535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 900/1786] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:03 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:03.609492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:03.621353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c697ab-bfb6-484b-be67-0abcc21748a8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.645814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:03.725685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.726398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.726677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.726949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.727586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.729534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.830380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 887/1787] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:03 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:03.834703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:03.844972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc35c2-8af0-4114-9839-c88003907c81 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.849711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.850348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.850647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.850913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.851549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.853272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.863240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 901/1788] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:03.867897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:03.877928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4840427-5e16-4d62-ad56-372cf9c42e5c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.883257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9339f-b9ba-45a0-a6df-073f1f0b46bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.883824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9339f-b9ba-45a0-a6df-073f1f0b46bd admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.884113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9339f-b9ba-45a0-a6df-073f1f0b46bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.884415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9339f-b9ba-45a0-a6df-073f1f0b46bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.885057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9339f-b9ba-45a0-a6df-073f1f0b46bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.886653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9339f-b9ba-45a0-a6df-073f1f0b46bd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.898450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 888/1789] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:03.902432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:03.915603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e03b6-1872-4688-b680-bec5573f016c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:03.919666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:03.920368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:03.920646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:03.920918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] PATH_INFO: `/v3/projects/ab4e05383edd4c638b83b025dab82fe8/users/13a0be32a18f4bd0a8c647d13c700ea5/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:03.937996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4e05383edd4c638b83b025dab82fe8, user_id=13a0be32a18f4bd0a8c647d13c700ea5, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:03.940378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:03.942602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:04.011966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 902/1790] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:03 2022] PUT /identity/v3/projects/ab4e05383edd4c638b83b025dab82fe8/users/13a0be32a18f4bd0a8c647d13c700ea5/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:04.013396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.013709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.013989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.045477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] MFA Rules not processed for user `13a0be32a18f4bd0a8c647d13c700ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:04.046747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:04.159243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 889/1791] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:04.160877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.261384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf264dcc-d3a2-46fc-b179-a7ecefebe88e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.263104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.263658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.263932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.264238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.264876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.266830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.398207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 903/1792] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:04 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:04.402082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.416399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c5a03-be0e-4638-8b6f-1ec0d328d70b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.488411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.489278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.489645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.489921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.490619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.492929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.628154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 890/1793] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:04 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:04.631328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.645987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48413-ada2-4625-8187-1ef56449be5a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.655690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.656362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.656741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.657161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.657819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.659428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.676429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 904/1794] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:04.681480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.692316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f79e9-c0d1-4e5f-9944-72273abff8e7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.697285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.698254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.698541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.698821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] PATH_INFO: `/v3/projects/46f70160365842409bf76a05e49d3358/users/f92103372f064bc482ea4836643694e5/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.728107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f70160365842409bf76a05e49d3358, user_id=f92103372f064bc482ea4836643694e5, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.728107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.808260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:04.814807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 891/1795] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:04 2022] PUT /identity/v3/projects/46f70160365842409bf76a05e49d3358/users/f92103372f064bc482ea4836643694e5/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:04.819320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.832116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc9d07-379e-4ced-be61-6a8921d34228 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.906028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ad15e5-30af-4380-8842-93e7efef2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.906725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad15e5-30af-4380-8842-93e7efef2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.907070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad15e5-30af-4380-8842-93e7efef2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.907408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ad15e5-30af-4380-8842-93e7efef2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.908185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad15e5-30af-4380-8842-93e7efef2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.909995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ad15e5-30af-4380-8842-93e7efef2be0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.921561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 905/1796] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:04.925938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:04.937281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd897ff-caeb-4fe1-94c6-033bca8cf684 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:04.942467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de103-105c-4a3e-b0b9-761d89f8b057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:04.943152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de103-105c-4a3e-b0b9-761d89f8b057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.943425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de103-105c-4a3e-b0b9-761d89f8b057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.943692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de103-105c-4a3e-b0b9-761d89f8b057 admin admin] PATH_INFO: `/v3/projects/46f70160365842409bf76a05e49d3358/users/f92103372f064bc482ea4836643694e5/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:04.945675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de103-105c-4a3e-b0b9-761d89f8b057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f70160365842409bf76a05e49d3358, user_id=f92103372f064bc482ea4836643694e5, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:04.948359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de103-105c-4a3e-b0b9-761d89f8b057 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:04.959038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 892/1797] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:04 2022] PUT /identity/v3/projects/46f70160365842409bf76a05e49d3358/users/f92103372f064bc482ea4836643694e5/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:04.970446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:04.970967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:04.971732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:05.017897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] MFA Rules not processed for user `f92103372f064bc482ea4836643694e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:05.021126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:05.065487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487961d-5647-434b-b332-2388b3c6c8ef None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:05.066165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487961d-5647-434b-b332-2388b3c6c8ef None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:05.066625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487961d-5647-434b-b332-2388b3c6c8ef None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:05.068211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 893/1798] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:20:05.086159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:05.086786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:05.087074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:05.134835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:05.138267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:05.138825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:05.206265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 906/1799] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:05.214925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:05.216824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:05.301763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 894/1800] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:20:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:05.315382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e088a-3fdf-474b-9138-e9bcc58ef51e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:05.321505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:05.322229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:05.322515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:05.322790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:05.351908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:05.355899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:05.371519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 907/1801] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:05.379921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:05.383763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:05.402472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9733c0-1f45-47ee-aa1c-89855c57c43b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:05.408670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:05.409292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:05.409567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:05.409836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:05.426392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:05.426392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:05.448276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 895/1802] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:06.690548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:06.690955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:06.742837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:06.755092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1fd1b-9c7d-4d66-994d-1a3020b63947 service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:06.761872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f92103372f064bc482ea4836643694e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46f70160365842409bf76a05e49d3358', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:06.762836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:06.763299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:06.763674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:06.764464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:06.764868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:06.767372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:06.771563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845129df-da8c-4d31-bc35-223224c1cfdf service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:06.779429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:06.780075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:06.780376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:06.780643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] PATH_INFO: `/v3/users/dd84114e57364a589aa82e6aa538f24a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:06.781782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd84114e57364a589aa82e6aa538f24a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:06.784060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:06.785474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 896/1803] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:06.800510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:06.814190 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdbd2a-5745-4d75-8b47-5bb66001d4f7 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:06.819225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f92103372f064bc482ea4836643694e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46f70160365842409bf76a05e49d3358', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:06.819985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:06.820404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:06.820778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:06.821533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:06.823801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:06.910028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 897/1804] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:06 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:06.914148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:07.009361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d39c7f-a10f-40d9-bf04-b4fb40deae0f tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:07.014508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd84114e57364a589aa82e6aa538f24a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.015152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd84114e57364a589aa82e6aa538f24a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.015285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f92103372f064bc482ea4836643694e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46f70160365842409bf76a05e49d3358', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:07.015920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:07.016299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:07.016716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:07.017468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:07.017869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:07.019676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:07.026342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd84114e57364a589aa82e6aa538f24a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.032696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 898/1805] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:07.045000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd84114e57364a589aa82e6aa538f24a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.045000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-245b303e-427c-4970-bcfc-448cd28e0151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd84114e57364a589aa82e6aa538f24a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.082680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:07.084475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:07.098022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f61cc4-123f-4ef9-88ec-6f8498f0377e tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:07.103379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f92103372f064bc482ea4836643694e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46f70160365842409bf76a05e49d3358', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:07.104004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:07.104312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:07.104581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] PATH_INFO: `/v3/projects/55dd3ea634d64208abeeed6f27abb08c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:07.105678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55dd3ea634d64208abeeed6f27abb08c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:07.107594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:07.125530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:07.150573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 908/1806] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:06 2022] DELETE /identity/v3/users/dd84114e57364a589aa82e6aa538f24a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:07.155068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:07.155473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:07.155748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:07.176637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:07.177932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:07.185865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:07.268743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 909/1807] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:07.277186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:07.279641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:07.286174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55dd3ea634d64208abeeed6f27abb08c', 'request_id': 'req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.305728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55dd3ea634d64208abeeed6f27abb08c', 'request_id': 'req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.318397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55dd3ea634d64208abeeed6f27abb08c', 'request_id': 'req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.350796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a870ae-1ad3-43e4-931d-96698d53d247 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:07.388548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] The token cache is being invalidate because project 55dd3ea634d64208abeeed6f27abb08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:07.389138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.390319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:07.395294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 899/1808] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:07 2022] DELETE /identity/v3/projects/55dd3ea634d64208abeeed6f27abb08c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:07.437579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:07.438199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:07.438471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:07.438746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:07.440716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:07.516494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:07.517955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:07.528220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 910/1809] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:08.259118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:08.260597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:08.281750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49b3a3-d541-4d5d-836c-2ae6e19ef659 tempest-VolumeQuotaClassesTest-1333764434 tempest-VolumeQuotaClassesTest-1333764434-project-admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:08.295062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:08.295439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:08.295889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:08.296192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] PATH_INFO: `/v3/projects/273cf3a062f04129819133e5d3d939f0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:08.299826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273cf3a062f04129819133e5d3d939f0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:08.302205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:08.404788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:08.406732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:08.432938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273cf3a062f04129819133e5d3d939f0', 'request_id': 'req-8523815b-562e-47d5-b2db-6ebcdde314e7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.433942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659f552-2701-4a5d-8570-aead75b7326e service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:08.449106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273cf3a062f04129819133e5d3d939f0', 'request_id': 'req-8523815b-562e-47d5-b2db-6ebcdde314e7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.458538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273cf3a062f04129819133e5d3d939f0', 'request_id': 'req-8523815b-562e-47d5-b2db-6ebcdde314e7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.466294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:08.513729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] The token cache is being invalidate because project 273cf3a062f04129819133e5d3d939f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:08.515816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.516608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.526094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 900/1810] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:08 2022] DELETE /identity/v3/projects/273cf3a062f04129819133e5d3d939f0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:08.530093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:08.531927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:08.576488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:08.577345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:08.577626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:08.577948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] PATH_INFO: `/v3/users/13a0be32a18f4bd0a8c647d13c700ea5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:08.579148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a0be32a18f4bd0a8c647d13c700ea5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:08.582585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:08.670422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523815b-562e-47d5-b2db-6ebcdde314e7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:08.676677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:08.677398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:08.677746 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:08.678089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] PATH_INFO: `/v3/users/79f1073e79aa43c784d852e4eb7ec2df` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:08.692713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f1073e79aa43c784d852e4eb7ec2df)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:08.696296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:08.766919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a0be32a18f4bd0a8c647d13c700ea5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.767698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a0be32a18f4bd0a8c647d13c700ea5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.775040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a0be32a18f4bd0a8c647d13c700ea5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.788727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a0be32a18f4bd0a8c647d13c700ea5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.789434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a0be32a18f4bd0a8c647d13c700ea5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.901779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 911/1811] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:08 2022] DELETE /identity/v3/users/13a0be32a18f4bd0a8c647d13c700ea5 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:08.902737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:08.904290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:08.922633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:08.945548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f1073e79aa43c784d852e4eb7ec2df'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.948217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f1073e79aa43c784d852e4eb7ec2df'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.951060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f1073e79aa43c784d852e4eb7ec2df'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:08.982622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f1073e79aa43c784d852e4eb7ec2df'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.023175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcc342e3-42fe-477a-a38f-2efba6208bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f1073e79aa43c784d852e4eb7ec2df'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.034888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ea723-ad12-497d-a9ec-2144b6af4ca9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:09.040232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:09.040809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:09.041305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:09.041510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] PATH_INFO: `/v3/users/f1477a0c0f7f4eba88e171bfb7c7ee20` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:09.042938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1477a0c0f7f4eba88e171bfb7c7ee20)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:09.044659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:09.161938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 901/1812] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:08 2022] DELETE /identity/v3/users/79f1073e79aa43c784d852e4eb7ec2df => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:09.163903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:09.164223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:09.164493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:09.187018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:09.188265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:09.251609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 902/1813] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:09.261440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:09.262829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:09.305408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:09.313413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1477a0c0f7f4eba88e171bfb7c7ee20'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.314326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1477a0c0f7f4eba88e171bfb7c7ee20'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.323547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1477a0c0f7f4eba88e171bfb7c7ee20'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.336026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608181a-6fd8-421a-b80e-d18ffcd4df75 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:09.341511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6abb-31b9-45a9-9b6b-d7ca895bbcfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:09.341889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6abb-31b9-45a9-9b6b-d7ca895bbcfc service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:09.342173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6abb-31b9-45a9-9b6b-d7ca895bbcfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:09.342440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6abb-31b9-45a9-9b6b-d7ca895bbcfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:09.347571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1477a0c0f7f4eba88e171bfb7c7ee20'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.349154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1477a0c0f7f4eba88e171bfb7c7ee20'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.357061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6abb-31b9-45a9-9b6b-d7ca895bbcfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:09.358862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6abb-31b9-45a9-9b6b-d7ca895bbcfc service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:09.373604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 903/1814] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:09.448569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 912/1815] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:08 2022] DELETE /identity/v3/users/f1477a0c0f7f4eba88e171bfb7c7ee20 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:09.453702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:09.453993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:09.454293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:09.476115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:09.477392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:09.561485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 904/1816] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:09.585303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:09.585303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:09.676470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8defc-c9e4-4e26-a2f5-ebf3d4b06707 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:09.688209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f381c1e-b597-4aaa-a24b-3e7a75de63a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:09.688209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381c1e-b597-4aaa-a24b-3e7a75de63a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:09.688209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381c1e-b597-4aaa-a24b-3e7a75de63a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:09.688209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f381c1e-b597-4aaa-a24b-3e7a75de63a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:09.697300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f381c1e-b597-4aaa-a24b-3e7a75de63a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:09.699151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f381c1e-b597-4aaa-a24b-3e7a75de63a2 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:09.711259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 913/1817] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:09.758726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:09.760281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:09.775700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1111f-5ba2-434d-8e20-c7b7e2b67872 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:09.783527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:09.783527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:09.783527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:09.783527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] PATH_INFO: `/v3/projects/9cf8791af2bb4ddca300562f54b150a1` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:09.785564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf8791af2bb4ddca300562f54b150a1)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:09.787309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:09.809435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:09.928904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf8791af2bb4ddca300562f54b150a1', 'request_id': 'req-717522c6-fbe6-46ac-8bac-09df9a24b38b'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.945253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf8791af2bb4ddca300562f54b150a1', 'request_id': 'req-717522c6-fbe6-46ac-8bac-09df9a24b38b'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:09.953791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf8791af2bb4ddca300562f54b150a1', 'request_id': 'req-717522c6-fbe6-46ac-8bac-09df9a24b38b'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.052684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] The token cache is being invalidate because project 9cf8791af2bb4ddca300562f54b150a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:10.053073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.054500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.055993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 905/1818] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:09 2022] DELETE /identity/v3/projects/9cf8791af2bb4ddca300562f54b150a1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:10.060931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e2cd-3254-460a-abd3-1089696a7a07 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.061224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e2cd-3254-460a-abd3-1089696a7a07 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.061487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417e2cd-3254-460a-abd3-1089696a7a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.085659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.087303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.100987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1417e2cd-3254-460a-abd3-1089696a7a07 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:10.102240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1417e2cd-3254-460a-abd3-1089696a7a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.172129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 914/1819] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:10.185725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.187014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.187014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.193652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717522c6-fbe6-46ac-8bac-09df9a24b38b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.199484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.200713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.201108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.201430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] PATH_INFO: `/v3/projects/ab4e05383edd4c638b83b025dab82fe8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.202803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4e05383edd4c638b83b025dab82fe8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.204827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.222266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:10.223660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.237730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 915/1820] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:10.245309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.256298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3377e87-706a-4ff8-858f-94595ed9bb15 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.262208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.262883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.263157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.263963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.264282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:10.264576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.266193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.279645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 916/1821] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:10.285956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.295392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434bce2-97db-45c9-b58d-fd823ee02204 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.300842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.301874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.301874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.302144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.304268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.306351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.373501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4e05383edd4c638b83b025dab82fe8', 'request_id': 'req-5516601a-1b42-4a34-9b8c-6a50768f1422'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.381596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4e05383edd4c638b83b025dab82fe8', 'request_id': 'req-5516601a-1b42-4a34-9b8c-6a50768f1422'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.387910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4e05383edd4c638b83b025dab82fe8', 'request_id': 'req-5516601a-1b42-4a34-9b8c-6a50768f1422'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.418535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 917/1822] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:10 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:10.422130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.457783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:10.459511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] The token cache is being invalidate because project ab4e05383edd4c638b83b025dab82fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:10.461072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.461946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.463731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 906/1823] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:10 2022] DELETE /identity/v3/projects/ab4e05383edd4c638b83b025dab82fe8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:10.464814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.466240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.507719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582a369-08fa-4db1-ac2c-5b2298445224 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.512980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.513592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.513902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.514137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.514762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.516712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.533432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516601a-1b42-4a34-9b8c-6a50768f1422 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.539317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.539989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.540300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.540576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] PATH_INFO: `/v3/projects/32f9416a2a454d61b7ce1c9984f28769` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.541702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f9416a2a454d61b7ce1c9984f28769)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.543614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.601969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 918/1824] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:10 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:10.603086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.604860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.617879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adba96-9121-4af1-b90d-26b0d423eb24 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.622896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.623588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.623883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.624207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] PATH_INFO: `/v3/users/f92103372f064bc482ea4836643694e5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.625346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92103372f064bc482ea4836643694e5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.627351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.649821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f9416a2a454d61b7ce1c9984f28769', 'request_id': 'req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.657739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f9416a2a454d61b7ce1c9984f28769', 'request_id': 'req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.663820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f9416a2a454d61b7ce1c9984f28769', 'request_id': 'req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.772398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] The token cache is being invalidate because project 32f9416a2a454d61b7ce1c9984f28769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:10.772693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.773832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.775334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 907/1825] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:10 2022] DELETE /identity/v3/projects/32f9416a2a454d61b7ce1c9984f28769 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:10.776199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.777590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.809189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92103372f064bc482ea4836643694e5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.810012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92103372f064bc482ea4836643694e5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.817899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92103372f064bc482ea4836643694e5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.831337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92103372f064bc482ea4836643694e5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.832049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92103372f064bc482ea4836643694e5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:10.843081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3aa3-608b-44d7-9f60-c11e9d9452cd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.847835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.848482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.848762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.849036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.849683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.851297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.861182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 908/1826] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:10.861920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.863512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:10.875934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379d88d-48d3-4a21-81e0-44827dd345c1 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:10.880862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:10.882076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:10.882349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:10.882634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] PATH_INFO: `/v3/users/4f684519bca34c5abcbb77e369c89a13` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:10.883745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f684519bca34c5abcbb77e369c89a13)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:10.885664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:10.938740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 919/1827] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:10 2022] DELETE /identity/v3/users/f92103372f064bc482ea4836643694e5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:10.939625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:10.940956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:11.010763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa42cff-8e27-4602-b9d6-79ee6cabecab admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:11.015699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:11.016490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.016773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.017037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.017679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:11.019295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:11.033311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 920/1828] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:11.039368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:11.044398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cdc7d-99ba-4642-8873-aaecb6f66c8b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:11.049601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db4b51-17ee-4e73-ba2a-ff5275874e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:11.050315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4b51-17ee-4e73-ba2a-ff5275874e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.050623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4b51-17ee-4e73-ba2a-ff5275874e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.050859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4b51-17ee-4e73-ba2a-ff5275874e81 admin admin] PATH_INFO: `/v3/projects/caf60af540714be59dec355565ab20a1/users/68ca6d020aee4c4a9fdac5eae4c074b6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.068859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4b51-17ee-4e73-ba2a-ff5275874e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf60af540714be59dec355565ab20a1, user_id=68ca6d020aee4c4a9fdac5eae4c074b6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:11.072318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4b51-17ee-4e73-ba2a-ff5275874e81 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:11.135215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:11.135569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f684519bca34c5abcbb77e369c89a13'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:11.136597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f684519bca34c5abcbb77e369c89a13'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:11.137464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f684519bca34c5abcbb77e369c89a13'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:11.149813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f684519bca34c5abcbb77e369c89a13'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:11.152654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 921/1829] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:11 2022] PUT /identity/v3/projects/caf60af540714be59dec355565ab20a1/users/68ca6d020aee4c4a9fdac5eae4c074b6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:11.165076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.165076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.165076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.182763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f684519bca34c5abcbb77e369c89a13'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:11.224063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] MFA Rules not processed for user `68ca6d020aee4c4a9fdac5eae4c074b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:11.224063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:11.254242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 909/1830] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:10 2022] DELETE /identity/v3/users/4f684519bca34c5abcbb77e369c89a13 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:11.358290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 922/1831] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:11.363216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:11.365276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:11.452732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa37e0-73a5-4067-aa9b-286e4a2de12e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:11.462127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:11.465266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.465266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.465266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.465702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:11.467870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:11.557683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 910/1832] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:11 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:11.561925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:11.629487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e27c39-a8da-42f9-a018-d282916e49a3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:11.637981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:11.641414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:11.642181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:11.763618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112557e-6a44-4b3a-adf0-ed5f067a613e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:11.774631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:11.777493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.785037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.787624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.793039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:11.794125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:11.794788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.796376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.796543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] PATH_INFO: `/v3/projects/46f70160365842409bf76a05e49d3358` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.801249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:11.804741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f70160365842409bf76a05e49d3358)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:11.806160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:11.933374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 923/1833] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:11 2022] POST /identity/v3/users => generated 298 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:11.937371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:11.946786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0728db6-802b-4957-afd2-0b162bc4c9bd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:11.951260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:11.951824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:11.952117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:11.952386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:11.953006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:11.954647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:11.964834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 924/1834] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:11.969096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:11.980229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b52cdb-d3d0-42cd-8be1-7644c024b2cc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.008619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f70160365842409bf76a05e49d3358', 'request_id': 'req-3b3377f1-2869-4525-b017-a5cac014d5fa'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.015012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f70160365842409bf76a05e49d3358', 'request_id': 'req-3b3377f1-2869-4525-b017-a5cac014d5fa'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.020581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f70160365842409bf76a05e49d3358', 'request_id': 'req-3b3377f1-2869-4525-b017-a5cac014d5fa'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.041419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce5985-bad4-4928-bd39-85bdb3dd8b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.042085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5985-bad4-4928-bd39-85bdb3dd8b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.042356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5985-bad4-4928-bd39-85bdb3dd8b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.042621 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce5985-bad4-4928-bd39-85bdb3dd8b82 admin admin] PATH_INFO: `/v3/projects/d84d7aa933e04558b262d3ed76322c90/users/e3d34e08dddd4d1db687696a67da2625/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.056819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5985-bad4-4928-bd39-85bdb3dd8b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84d7aa933e04558b262d3ed76322c90, user_id=e3d34e08dddd4d1db687696a67da2625, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.059597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce5985-bad4-4928-bd39-85bdb3dd8b82 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.092473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] The token cache is being invalidate because project 46f70160365842409bf76a05e49d3358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:12.092763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.093399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.094941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 911/1835] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:11 2022] DELETE /identity/v3/projects/46f70160365842409bf76a05e49d3358 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:12.095769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.097074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.109367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3377f1-2869-4525-b017-a5cac014d5fa admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.114420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.115022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.115300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.116549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] PATH_INFO: `/v3/projects/4626bab06bcf48b38825d536a9a21370` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.117239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4626bab06bcf48b38825d536a9a21370)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.119226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.179854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 925/1836] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:11 2022] PUT /identity/v3/projects/d84d7aa933e04558b262d3ed76322c90/users/e3d34e08dddd4d1db687696a67da2625/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:12.181208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.181484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.181747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.202384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:12.203665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.214001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4626bab06bcf48b38825d536a9a21370', 'request_id': 'req-3141b542-2ca3-4d4b-9142-947350748519'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.220197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4626bab06bcf48b38825d536a9a21370', 'request_id': 'req-3141b542-2ca3-4d4b-9142-947350748519'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.226487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4626bab06bcf48b38825d536a9a21370', 'request_id': 'req-3141b542-2ca3-4d4b-9142-947350748519'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.267245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 926/1837] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:12.268281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.269547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.281016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bc770-0be7-4878-a25d-3ef9beaecb12 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.285654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e2207-16a8-4117-a87c-39c8f7e281d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.286254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e2207-16a8-4117-a87c-39c8f7e281d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.286787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e2207-16a8-4117-a87c-39c8f7e281d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.287053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e2207-16a8-4117-a87c-39c8f7e281d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.288491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e2207-16a8-4117-a87c-39c8f7e281d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.293514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:12.293842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e2207-16a8-4117-a87c-39c8f7e281d4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.295731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] The token cache is being invalidate because project 4626bab06bcf48b38825d536a9a21370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:12.296030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.296702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3141b542-2ca3-4d4b-9142-947350748519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:12.298664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 912/1838] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:12 2022] DELETE /identity/v3/projects/4626bab06bcf48b38825d536a9a21370 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:12.300197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.300416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.300639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.303319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 927/1839] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:12.305226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.310620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.310620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.322012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:12.323249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.326910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:12.328190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.332473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 913/1840] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:12.333616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.334782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.339714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 928/1841] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:12.347037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528ce12-70a5-4d75-a8ec-a2b477d8fb49 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.347668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.352690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21e549-3fb0-4526-ab14-06dc38616c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.357583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21e549-3fb0-4526-ab14-06dc38616c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.357583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21e549-3fb0-4526-ab14-06dc38616c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.357583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21e549-3fb0-4526-ab14-06dc38616c10 admin admin] PATH_INFO: `/v3/projects/d84d7aa933e04558b262d3ed76322c90/users/e3d34e08dddd4d1db687696a67da2625/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.357583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21e549-3fb0-4526-ab14-06dc38616c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84d7aa933e04558b262d3ed76322c90, user_id=e3d34e08dddd4d1db687696a67da2625, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.357891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a78288-5214-43eb-93b3-3774ef9c3321 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.358794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21e549-3fb0-4526-ab14-06dc38616c10 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.362611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.363216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.363488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.363831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.364448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:12.364753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.366947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.371546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 914/1842] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:12 2022] PUT /identity/v3/projects/d84d7aa933e04558b262d3ed76322c90/users/e3d34e08dddd4d1db687696a67da2625/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:12.373831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8427d-009c-4260-a495-402b16a2daf0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.374296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8427d-009c-4260-a495-402b16a2daf0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.374904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8427d-009c-4260-a495-402b16a2daf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.382992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 929/1843] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:12.384309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.395845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dec56e-3aea-421d-90fb-1138daf0acc8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.401755 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a2a8427d-009c-4260-a495-402b16a2daf0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:12.403063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a2a8427d-009c-4260-a495-402b16a2daf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.479746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.480498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.480906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 915/1844] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:12.481417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.481417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.482180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.482295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.482619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.482988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.484484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.517177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] MFA Rules not processed for user `e3d34e08dddd4d1db687696a67da2625`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:12.518742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.550008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 930/1845] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/projects => generated 393 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:12.550922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.606164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 916/1846] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:12.606785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.610852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:12.628229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66b374-cce2-480a-80a6-ffe395f833b2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.628229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.628229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.628229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.629288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.629288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.629702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e83d-bd08-4b0b-9e22-44c4568b6a1e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.630880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.635333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.636166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.636623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.636962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.637706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:12.638090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.639897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.651970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 931/1847] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:12.652987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.654731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:12.713032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8513c-c4a4-4322-a6fc-03f84f7f0255 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.719315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.720289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.720638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.721251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.723931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 917/1848] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:12.724964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.736870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc38e3-b22e-4fad-8272-ec7b05bba408 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.742296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.743032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.743319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.743568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.744232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.746401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.793261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.796683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.808281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 932/1849] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:12.809338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.826110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:12.826326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64501e31-d74d-40e6-8324-7e6e5d4790ec service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.827482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 918/1850] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:12.828589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.892464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:12.937761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:12.939173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:12.939578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:12.940061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:12.941654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:12.949934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:12.976739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 933/1851] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:12.979685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:12.990497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:12.993613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abb969-55a7-4e0e-b3fb-1837f0f549c2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:12.998652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550444eb-6ebd-433a-b3f7-6db72f6b2703 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.004630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.005255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.005535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.005805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.006457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.008012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.008261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.008753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.009031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.009300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.009967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.011932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.022446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 934/1852] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:13.022446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.054395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:13.089761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55018eb6-b9ee-4b60-a8da-cd939bb265f6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.094289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.094971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.095247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.095989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.106589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:13.106781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 919/1853] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:12 2022] POST /identity/v3/users => generated 292 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:13.106998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.135085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721051c-fb8c-4270-857e-d404f48ec1f2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.143534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07167b0-413d-4e43-90bd-37621adbd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.144303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07167b0-413d-4e43-90bd-37621adbd27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.144579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07167b0-413d-4e43-90bd-37621adbd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.144849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07167b0-413d-4e43-90bd-37621adbd27d admin admin] PATH_INFO: `/v3/projects/2136bd9386924e8a8c6d8f9792458c41/users/9f7504fa3cda4ef7af62242e6c9aa74d/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.162306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07167b0-413d-4e43-90bd-37621adbd27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2136bd9386924e8a8c6d8f9792458c41, user_id=9f7504fa3cda4ef7af62242e6c9aa74d, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.166110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07167b0-413d-4e43-90bd-37621adbd27d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.172665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.174107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.184319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 935/1854] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:13.185152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.196876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34356b7e-ba56-4ea9-8b55-a01db6af6a0a service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.203365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.204661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.205059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.205494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.206226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.207829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.219643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 936/1855] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:13.224402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.238841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239fbf30-8be4-49cf-a784-be58d2c122cd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.244385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 920/1856] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:13 2022] PUT /identity/v3/projects/2136bd9386924e8a8c6d8f9792458c41/users/9f7504fa3cda4ef7af62242e6c9aa74d/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:13.248149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.248733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.249209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.313721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] MFA Rules not processed for user `9f7504fa3cda4ef7af62242e6c9aa74d`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:13.314592 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:13.329234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:13.337678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.338314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.338635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.341475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.341475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.341695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.353527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 937/1857] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:13.357589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.376975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03196a95-260b-42ab-a385-a6634432f2eb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.392452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c335107-2cbd-4d9b-acd2-7dc9cf729f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.395334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c335107-2cbd-4d9b-acd2-7dc9cf729f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.395779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c335107-2cbd-4d9b-acd2-7dc9cf729f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.398698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c335107-2cbd-4d9b-acd2-7dc9cf729f48 admin admin] PATH_INFO: `/v3/projects/e9c184bde1c147528715a3dd96359fd5/users/f87eb6ae1f7045098cc2798e1f77565f/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.417803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 921/1858] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:13.427426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.428042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c335107-2cbd-4d9b-acd2-7dc9cf729f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c184bde1c147528715a3dd96359fd5, user_id=f87eb6ae1f7045098cc2798e1f77565f, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.431717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c335107-2cbd-4d9b-acd2-7dc9cf729f48 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.440282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00443f7-6fd0-4b90-94f9-111ecdccabd5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.445616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.446223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.447694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.447694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.447694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.449320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.510809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 938/1859] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:13 2022] PUT /identity/v3/projects/e9c184bde1c147528715a3dd96359fd5/users/f87eb6ae1f7045098cc2798e1f77565f/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:13.522929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.525068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.525068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.525255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:13.582295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 922/1860] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:13 2022] POST /identity/v3/projects => generated 391 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:13.586701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.591527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] MFA Rules not processed for user `f87eb6ae1f7045098cc2798e1f77565f`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:13.599682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:13.778694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f07fce-77b8-4d3b-9093-90a0f1f96840 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.784637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.785578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.785856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.786266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.787166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.791980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.794036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 939/1861] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:13.798564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.812424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32c3ef-3136-45b1-84cd-32890cdac005 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.818617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:13.821627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:13.821627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:13.821627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:13.821627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:13.822694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:13.916988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 923/1862] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:13 2022] POST /identity/v3/users => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:13.916988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.917661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:13.920510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 940/1863] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:13 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:13.920510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:13.935483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fa54f-ccf5-4652-a3d6-dc4d1e2b083b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:13.999222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062a2eb-8807-4c12-9516-5f15708d1689 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.005524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.006464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.007497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.007968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] PATH_INFO: `/v3/users/8d59f3fa17ef483a841ffd5b62ca3059` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.009617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d59f3fa17ef483a841ffd5b62ca3059)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.011855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.028266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.029339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.029623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.032300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.035239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.036480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.058133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 941/1864] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:14.061105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.074708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13570959-ccbb-4110-95d5-08298b236cd0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.080316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.080803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.081081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.081372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.081990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.086084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.190987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 942/1865] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:14 2022] POST /identity/v3/users => generated 298 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:14.190987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.215392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffb8e0-ac94-4d57-8e9d-f08978a44d1a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.216599 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:14.238357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.238934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d59f3fa17ef483a841ffd5b62ca3059'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:14.239658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d59f3fa17ef483a841ffd5b62ca3059'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:14.240292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d59f3fa17ef483a841ffd5b62ca3059'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:14.240745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.241834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.253220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] PATH_INFO: `/v3/projects/ed82fc3edbbb4e9b8779968fc6bfaaf1/users/ac21ea9e668e42d1a071ee03b7b52622/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.253372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d59f3fa17ef483a841ffd5b62ca3059'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:14.259508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:14.262869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed82fc3edbbb4e9b8779968fc6bfaaf1, user_id=ac21ea9e668e42d1a071ee03b7b52622, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.265846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.281860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d59f3fa17ef483a841ffd5b62ca3059'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:14.317179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 943/1866] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:14 2022] PUT /identity/v3/projects/ed82fc3edbbb4e9b8779968fc6bfaaf1/users/ac21ea9e668e42d1a071ee03b7b52622/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:14.318610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.320664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.333312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 924/1867] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:13 2022] DELETE /identity/v3/users/8d59f3fa17ef483a841ffd5b62ca3059 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:14.334520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.340998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.404458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f9f72-6f32-450d-ac91-ac68cd78bceb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.410876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbaf0aa-fd83-4e89-a00c-50f1496013e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.412209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf0aa-fd83-4e89-a00c-50f1496013e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.412653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf0aa-fd83-4e89-a00c-50f1496013e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.413968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf0aa-fd83-4e89-a00c-50f1496013e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.413968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaf0aa-fd83-4e89-a00c-50f1496013e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.415750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbaf0aa-fd83-4e89-a00c-50f1496013e0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.419484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ced750-3b5a-4cd1-ad74-38c99981cb58 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.425658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.426543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.427010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.427410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.428100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.429197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 944/1868] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:14.430587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.430786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.431225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.431851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.450113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 925/1869] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:14.450113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.454207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:14.455411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.458563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3a9138-cbec-4a34-889d-6d25b1636fc7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.489740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 945/1870] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:14.489740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.489964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d2ba6-a309-4b88-9a30-554a6ea142fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.489964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2ba6-a309-4b88-9a30-554a6ea142fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.489964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2ba6-a309-4b88-9a30-554a6ea142fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.489964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d2ba6-a309-4b88-9a30-554a6ea142fb admin admin] PATH_INFO: `/v3/projects/8029995fead64a8ab22d79a170fb411c/users/5b2ed445f8024530a7089122235d48fd/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.490258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b1442-eef9-478c-876d-51e06c7ac3c7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.496989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892639-248a-4b40-94ac-346480599868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.498105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892639-248a-4b40-94ac-346480599868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.498528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892639-248a-4b40-94ac-346480599868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.498968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892639-248a-4b40-94ac-346480599868 admin admin] PATH_INFO: `/v3/projects/ed82fc3edbbb4e9b8779968fc6bfaaf1/users/ac21ea9e668e42d1a071ee03b7b52622/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.504165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892639-248a-4b40-94ac-346480599868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed82fc3edbbb4e9b8779968fc6bfaaf1, user_id=ac21ea9e668e42d1a071ee03b7b52622, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.505461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2ba6-a309-4b88-9a30-554a6ea142fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8029995fead64a8ab22d79a170fb411c, user_id=5b2ed445f8024530a7089122235d48fd, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.507810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892639-248a-4b40-94ac-346480599868 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.508816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d2ba6-a309-4b88-9a30-554a6ea142fb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.520461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 946/1871] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:14 2022] PUT /identity/v3/projects/ed82fc3edbbb4e9b8779968fc6bfaaf1/users/ac21ea9e668e42d1a071ee03b7b52622/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:14.521251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892639-248a-4b40-94ac-346480599868 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.523588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-60892639-248a-4b40-94ac-346480599868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.591207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892639-248a-4b40-94ac-346480599868 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.597462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.598131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.598408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.598730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.628694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 926/1872] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:14 2022] PUT /identity/v3/projects/8029995fead64a8ab22d79a170fb411c/users/5b2ed445f8024530a7089122235d48fd/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:14.628694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.628694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.628694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.664272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.665885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.666084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] MFA Rules not processed for user `ac21ea9e668e42d1a071ee03b7b52622`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:14.667340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.676722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 947/1873] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:14.677249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.689671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938da0c-e71b-404c-9077-719341850e3e service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.715971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:14.749403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 927/1874] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:14.763852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.765328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.778467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:14.790189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.792273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.793911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.794424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.796650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.802012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.827165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 948/1875] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:14.833161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.847548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd1da9-b5a1-4651-b8f7-c276653816cb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.852389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664921e-bd4c-401a-8c3d-1da902decde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.852577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8f7f1-8430-4b4f-8100-25e17cd9cb7a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:14.853644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664921e-bd4c-401a-8c3d-1da902decde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.853919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664921e-bd4c-401a-8c3d-1da902decde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.854187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664921e-bd4c-401a-8c3d-1da902decde1 admin admin] PATH_INFO: `/v3/projects/8029995fead64a8ab22d79a170fb411c/users/5b2ed445f8024530a7089122235d48fd/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.856234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:14.856378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664921e-bd4c-401a-8c3d-1da902decde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8029995fead64a8ab22d79a170fb411c, user_id=5b2ed445f8024530a7089122235d48fd, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.856841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.857113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.857380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.860416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664921e-bd4c-401a-8c3d-1da902decde1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.868588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:14.870150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:14.873173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 949/1876] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:14 2022] PUT /identity/v3/projects/8029995fead64a8ab22d79a170fb411c/users/5b2ed445f8024530a7089122235d48fd/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:14.886026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 928/1877] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:14.887923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:14.888139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:14.888417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:14.942851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] MFA Rules not processed for user `5b2ed445f8024530a7089122235d48fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:14.942851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.944808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:14.944808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:14.957319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787378f6-11d5-474b-b215-7d563677c3d7 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:15.014974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:15.015891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 950/1878] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:15.016212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.016748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.019253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.020569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:15.027407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:15.039943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ccaf2-68fe-40c0-a878-1f91836547a9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:15.044049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:15.044685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.044962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.045233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.047196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:15.100714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:15.102102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:15.110980 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 929/1879] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:15.114902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:15.116938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:15.125863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 951/1880] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:15.196678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:15.208657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:15.359182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93cfc-a14b-42b4-8a2d-3a679a89279b service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:15.369010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:15.369805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.370158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.370558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] PATH_INFO: `/v3/projects/72d597829f444df884cad95b8c7f5fdf` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.371892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d597829f444df884cad95b8c7f5fdf)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:15.374035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:15.381363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:15.542872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d597829f444df884cad95b8c7f5fdf', 'request_id': 'req-177475fc-5025-4954-8694-c2030d88265a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.550445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d597829f444df884cad95b8c7f5fdf', 'request_id': 'req-177475fc-5025-4954-8694-c2030d88265a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.557653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d597829f444df884cad95b8c7f5fdf', 'request_id': 'req-177475fc-5025-4954-8694-c2030d88265a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.648751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] The token cache is being invalidate because project 72d597829f444df884cad95b8c7f5fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:15.649351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.650039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.652326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 930/1881] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:15 2022] DELETE /identity/v3/projects/72d597829f444df884cad95b8c7f5fdf => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:15.656754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:15.670053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28106-cc76-4ffd-a160-35601b09062d service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:15.691874 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:15.733870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:15.734780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:15.735552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:15.735552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] PATH_INFO: `/v3/users/112ca7620d864182abd7dcd04c910f2e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:15.736528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=112ca7620d864182abd7dcd04c910f2e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:15.752623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:15.970771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112ca7620d864182abd7dcd04c910f2e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.971916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112ca7620d864182abd7dcd04c910f2e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.981953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112ca7620d864182abd7dcd04c910f2e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:15.999069 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112ca7620d864182abd7dcd04c910f2e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:16.000295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-077ddd06-93e7-419f-878e-80d09eee7ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112ca7620d864182abd7dcd04c910f2e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:16.099544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 952/1882] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:15 2022] DELETE /identity/v3/users/112ca7620d864182abd7dcd04c910f2e => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:16.706267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:16.722335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:16.724970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177475fc-5025-4954-8694-c2030d88265a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:16.792547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:16.796508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:16.796796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:16.797076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] PATH_INFO: `/v3/projects/60f90db8c62f486589993598650e89d5` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:16.798284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f90db8c62f486589993598650e89d5)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:16.800360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:16.952393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f90db8c62f486589993598650e89d5', 'request_id': 'req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:16.959379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f90db8c62f486589993598650e89d5', 'request_id': 'req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:16.965999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f90db8c62f486589993598650e89d5', 'request_id': 'req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:17.052555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] The token cache is being invalidate because project 60f90db8c62f486589993598650e89d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:17.052845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:17.053501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6bf829ba-11fc-4ce6-b51a-47ee1189ada0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:17.055084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 931/1883] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:16 2022] DELETE /identity/v3/projects/60f90db8c62f486589993598650e89d5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:17.060242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.060698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.060810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.081742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:17.082971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:17.148815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 953/1884] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:17.156842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.157160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.157439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.180348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:17.181615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:17.190439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 932/1885] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:17.196784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:17.207103 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e10f6a-3a73-4c75-89d0-009add337999 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:17.213385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:17.214214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.214491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.214758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.215438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:17.215766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:17.217409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.233707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 954/1886] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:17.239070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:17.252060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4a246-b1a0-4d01-80d1-24da80477935 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:17.260130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:17.261173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.261688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.262195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.263296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:17.265643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.286402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:17.371685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 933/1887] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:17 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:17.379284 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:17.391549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da9632d-bd34-4caf-b288-703f6ea1d749 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:17.425517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:17.458181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:17.458792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.459067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.459341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.460635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:17.462687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.568126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 955/1888] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:17 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:17.572930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:17.587164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e725-a310-4906-acf8-0ca04899b09c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:17.595328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:17.595328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.595328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.595328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.595784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:17.608370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.620823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 934/1889] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:17.626605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:17.637853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a527-b0f5-4b29-ab2f-d4f74ba7a046 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:17.643359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fcca3-3d67-4c75-92a3-cf9d3c03e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:17.651725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fcca3-3d67-4c75-92a3-cf9d3c03e66d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.651725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fcca3-3d67-4c75-92a3-cf9d3c03e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.651725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fcca3-3d67-4c75-92a3-cf9d3c03e66d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.651725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fcca3-3d67-4c75-92a3-cf9d3c03e66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:17.653440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fcca3-3d67-4c75-92a3-cf9d3c03e66d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.664612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 956/1890] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:17.668939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:17.679706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8dcdd6-ec2a-4a04-ab84-3f7ddf3ae1c5 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:17.686351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:17.687049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.687325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.687594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] PATH_INFO: `/v3/projects/573e49ec9117427598fbb7dd3ca50ae3/users/9d6849db7d834d8e96ca0ba7866e458c/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.705358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=573e49ec9117427598fbb7dd3ca50ae3, user_id=9d6849db7d834d8e96ca0ba7866e458c, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:17.707922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:17.808774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 935/1891] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:17 2022] PUT /identity/v3/projects/573e49ec9117427598fbb7dd3ca50ae3/users/9d6849db7d834d8e96ca0ba7866e458c/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:17.821399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:17.821679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:17.821988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:17.859453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] MFA Rules not processed for user `9d6849db7d834d8e96ca0ba7866e458c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:17.860731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:17.940322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 957/1892] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:17.945534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.027317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94748-34c4-4636-97d6-1a499fc18d2d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.032023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.032782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.032991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.033214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.033855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.035764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:18.128518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 936/1893] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:17 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:18.133105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.144306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5513feb7-e893-4ad6-b83b-bf8831a2e3e1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.212159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.212784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.213060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.213326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.214024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.215870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:18.293397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 958/1894] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:18 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:18.295989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.324312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c248d8-b6fd-4888-8c5e-a7b1e6735dc2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.330598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.330598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.331318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.333588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.335274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.338587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:18.360861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 937/1895] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:18.365540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.379413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2bea-17b9-4961-8f54-75da50ea8f45 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.384723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.385405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.385682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.385952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] PATH_INFO: `/v3/projects/3394c1879fba41198c886399963ff974/users/e2b13ccb9cb14f198125acc5cc561ac5/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.402109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3394c1879fba41198c886399963ff974, user_id=e2b13ccb9cb14f198125acc5cc561ac5, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.405225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:18.487907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 959/1896] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:18 2022] PUT /identity/v3/projects/3394c1879fba41198c886399963ff974/users/e2b13ccb9cb14f198125acc5cc561ac5/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:18.492816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.503047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605747-177d-407b-8aa5-7f2e4ed5f418 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.602895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bbc0a-91e0-4f54-99aa-9e5f536d1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.603521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bbc0a-91e0-4f54-99aa-9e5f536d1a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.603803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bbc0a-91e0-4f54-99aa-9e5f536d1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.604076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bbc0a-91e0-4f54-99aa-9e5f536d1a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.604751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bbc0a-91e0-4f54-99aa-9e5f536d1a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.606675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bbc0a-91e0-4f54-99aa-9e5f536d1a3a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:18.623143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 938/1897] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:18.628250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.635370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:18.639215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc93e3-dd24-429b-8bb0-3188f9dd20eb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.643929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.644628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.644907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.645223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] PATH_INFO: `/v3/projects/3394c1879fba41198c886399963ff974/users/e2b13ccb9cb14f198125acc5cc561ac5/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.653633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3394c1879fba41198c886399963ff974, user_id=e2b13ccb9cb14f198125acc5cc561ac5, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.656394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:18.668640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 960/1898] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:18 2022] PUT /identity/v3/projects/3394c1879fba41198c886399963ff974/users/e2b13ccb9cb14f198125acc5cc561ac5/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:18.680133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.680414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.680692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.710773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] MFA Rules not processed for user `e2b13ccb9cb14f198125acc5cc561ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:18.712752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:18.733196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:18.796274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 939/1899] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:18.796413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:18.798175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:18.903050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b9066-4563-414c-8ba8-4d370ea38dca admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:18.906927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:18.907582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:18.907861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:18.908304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] PATH_INFO: `/v3/users/68ca6d020aee4c4a9fdac5eae4c074b6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:18.909501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ca6d020aee4c4a9fdac5eae4c074b6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:18.911429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:19.053577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:19.058531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:19.144316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c732529-f6b9-4f70-a453-476c060e6c5e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:19.152138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04457335-9f11-4d26-ace8-69ab3303aab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:19.152138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457335-9f11-4d26-ace8-69ab3303aab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:19.152138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457335-9f11-4d26-ace8-69ab3303aab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:19.152138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04457335-9f11-4d26-ace8-69ab3303aab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:19.153070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ca6d020aee4c4a9fdac5eae4c074b6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:19.163729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457335-9f11-4d26-ace8-69ab3303aab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:19.166063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04457335-9f11-4d26-ace8-69ab3303aab9 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:19.169853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ca6d020aee4c4a9fdac5eae4c074b6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:19.178075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 940/1900] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:19.202392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ca6d020aee4c4a9fdac5eae4c074b6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:19.226038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ca6d020aee4c4a9fdac5eae4c074b6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:19.227634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ca6d020aee4c4a9fdac5eae4c074b6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:19.322638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 961/1901] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:18 2022] DELETE /identity/v3/users/68ca6d020aee4c4a9fdac5eae4c074b6 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:19.331243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:19.331688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:19.331963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:19.372117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:19.397379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:19.505642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 941/1902] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:19.516318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:19.520833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:19.590514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03db1e-22ba-4b2e-bfd0-06fa73c64db1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:19.594984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:19.595615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:19.595889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:19.596314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:19.612768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:19.614327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:19.626720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 962/1903] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:20.374121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:20.375948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:20.390255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34834fc1-3d9d-4b68-b52d-297fca1354df None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:20.396981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:20.398492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:20.398950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:20.399398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] PATH_INFO: `/v3/users/9d6849db7d834d8e96ca0ba7866e458c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:20.400835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6849db7d834d8e96ca0ba7866e458c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:20.403059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:20.645006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:20.648022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:20.664834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6849db7d834d8e96ca0ba7866e458c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.669400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6849db7d834d8e96ca0ba7866e458c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.669400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6849db7d834d8e96ca0ba7866e458c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.674438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549990f-568d-4b16-9c9d-516d11db0416 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:20.678735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:20.681377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6849db7d834d8e96ca0ba7866e458c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.686682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:20.688637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:20.690833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:20.691244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] PATH_INFO: `/v3/projects/caf60af540714be59dec355565ab20a1` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:20.693605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf60af540714be59dec355565ab20a1)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:20.701005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:20.714368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ef0396b5-cab1-48c3-9b11-79314ae5dc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6849db7d834d8e96ca0ba7866e458c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.723329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:20.801587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 942/1904] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:20 2022] DELETE /identity/v3/users/9d6849db7d834d8e96ca0ba7866e458c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:20.806907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:20.807176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:20.807450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:20.829360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:20.830641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:20.877463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf60af540714be59dec355565ab20a1', 'request_id': 'req-110c7c59-6d44-4354-b115-d35634d2f357'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.887069 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf60af540714be59dec355565ab20a1', 'request_id': 'req-110c7c59-6d44-4354-b115-d35634d2f357'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.893532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf60af540714be59dec355565ab20a1', 'request_id': 'req-110c7c59-6d44-4354-b115-d35634d2f357'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:20.895561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 943/1905] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:20.905929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:20.907361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:20.966130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561c2de-a435-4f7f-a6c6-87c84cd46707 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:21.015255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] The token cache is being invalidate because project caf60af540714be59dec355565ab20a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:21.015598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.016372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.020831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:21.021535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:21.021859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:21.022027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:21.022692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 963/1906] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:20 2022] DELETE /identity/v3/projects/caf60af540714be59dec355565ab20a1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:21.023650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:21.023878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:21.025044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:21.083769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:21.097671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c7c59-6d44-4354-b115-d35634d2f357 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:21.102697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:21.103353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:21.103621 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:21.103892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] PATH_INFO: `/v3/users/e3d34e08dddd4d1db687696a67da2625` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:21.105077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d34e08dddd4d1db687696a67da2625)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:21.106317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:21.107217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:21.107998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:21.118562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 944/1907] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:21.354415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d34e08dddd4d1db687696a67da2625'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.358808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d34e08dddd4d1db687696a67da2625'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.379258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d34e08dddd4d1db687696a67da2625'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.396825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d34e08dddd4d1db687696a67da2625'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.397602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d34e08dddd4d1db687696a67da2625'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:21.506262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 964/1908] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:21 2022] DELETE /identity/v3/users/e3d34e08dddd4d1db687696a67da2625 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:21.792556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:21.795010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:21.817267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b04380-a343-46ff-bd57-e68c360e1839 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:21.907914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:21.909007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:21.909525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:21.910017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] PATH_INFO: `/v3/projects/573e49ec9117427598fbb7dd3ca50ae3` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:21.911689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] RBAC: Authorizing `identity:delete_project(project_id=573e49ec9117427598fbb7dd3ca50ae3)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:21.915052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:21.963918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:21.965686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:21.989926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36436be-dd08-4b82-a087-230c7977044e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:21.999976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.000832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.001174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.001509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] PATH_INFO: `/v3/users/9f7504fa3cda4ef7af62242e6c9aa74d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.004826 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7504fa3cda4ef7af62242e6c9aa74d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.007080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:22.030556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:22.086226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573e49ec9117427598fbb7dd3ca50ae3', 'request_id': 'req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.095028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573e49ec9117427598fbb7dd3ca50ae3', 'request_id': 'req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.102014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573e49ec9117427598fbb7dd3ca50ae3', 'request_id': 'req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.214898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] The token cache is being invalidate because project 573e49ec9117427598fbb7dd3ca50ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:22.215444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.216605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.218803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 945/1909] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:21 2022] DELETE /identity/v3/projects/573e49ec9117427598fbb7dd3ca50ae3 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:22.221297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:22.223454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.282367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7504fa3cda4ef7af62242e6c9aa74d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.283575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7504fa3cda4ef7af62242e6c9aa74d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.310881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7504fa3cda4ef7af62242e6c9aa74d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.323092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fb5ac-7237-4f2a-945b-ff6948bfd4de admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:22.329366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.330031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.330307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.330576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] PATH_INFO: `/v3/projects/d84d7aa933e04558b262d3ed76322c90` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.335762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84d7aa933e04558b262d3ed76322c90)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.336969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7504fa3cda4ef7af62242e6c9aa74d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.339443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:22.341084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7504fa3cda4ef7af62242e6c9aa74d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.354927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:22.444163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 965/1910] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:21 2022] DELETE /identity/v3/users/9f7504fa3cda4ef7af62242e6c9aa74d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:22.445498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:22.447386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.492919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84d7aa933e04558b262d3ed76322c90', 'request_id': 'req-56002a9a-5bcb-4e27-9aeb-4f254707251a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.506043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84d7aa933e04558b262d3ed76322c90', 'request_id': 'req-56002a9a-5bcb-4e27-9aeb-4f254707251a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.518895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84d7aa933e04558b262d3ed76322c90', 'request_id': 'req-56002a9a-5bcb-4e27-9aeb-4f254707251a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.544063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015ad09-bf4e-4690-adfa-d8114afe6598 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:22.603189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] The token cache is being invalidate because project d84d7aa933e04558b262d3ed76322c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:22.603482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.604268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-56002a9a-5bcb-4e27-9aeb-4f254707251a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.609622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 946/1911] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:22 2022] DELETE /identity/v3/projects/d84d7aa933e04558b262d3ed76322c90 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:22.610946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07b963-5694-405c-9544-e428cd84b683 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.611227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07b963-5694-405c-9544-e428cd84b683 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.611499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07b963-5694-405c-9544-e428cd84b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.628366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.629202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.629485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.629761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] PATH_INFO: `/v3/users/e2b13ccb9cb14f198125acc5cc561ac5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.631271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b13ccb9cb14f198125acc5cc561ac5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.634243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:22.644545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-eb07b963-5694-405c-9544-e428cd84b683 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:22.648430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-eb07b963-5694-405c-9544-e428cd84b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.661140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 947/1912] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:22.663499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.663938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.664386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.691470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:22.693107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.710793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 948/1913] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:22.710793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:22.710793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.778160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1c6b-befb-4b4f-bc82-9b6bb5dbd646 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:22.782135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e314b0-177f-48b7-a815-7a1c77bca465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.782752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e314b0-177f-48b7-a815-7a1c77bca465 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.783031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e314b0-177f-48b7-a815-7a1c77bca465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.783329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e314b0-177f-48b7-a815-7a1c77bca465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.794084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e314b0-177f-48b7-a815-7a1c77bca465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.795537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e314b0-177f-48b7-a815-7a1c77bca465 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:22.807175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 949/1914] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:22.808558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.808843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.809102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.833344 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:22.834588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.848759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 950/1915] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:22.857511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:22.881687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b13ccb9cb14f198125acc5cc561ac5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.882468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b13ccb9cb14f198125acc5cc561ac5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.885206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543582e-f692-4f40-8777-241f46baabf5 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:22.896854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b13ccb9cb14f198125acc5cc561ac5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.897984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.898705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.899053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.899397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.901836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:22.902228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.905700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:22.925889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b13ccb9cb14f198125acc5cc561ac5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.927074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b13ccb9cb14f198125acc5cc561ac5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:22.931525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 951/1916] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:22.937204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:22.941395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:22.967892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577b9e5-22b1-42fc-92ab-f89a8ef695e1 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:22.979551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:22.980630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:22.980630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:22.980839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:22.981491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:22.983514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.015920 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 966/1917] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:22 2022] DELETE /identity/v3/users/e2b13ccb9cb14f198125acc5cc561ac5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:23.090039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 952/1918] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:22 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:23.091624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.156381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:23.191177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa835a0-db1d-4a47-b888-b1505ee4304d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.273593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.274478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.275372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.275888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.276847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.279466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.389527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 967/1919] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:23 2022] POST /identity/v3/users => generated 286 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:23.394766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.420223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20940b6-c45f-4c15-87ae-dd64090dc6a6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.430247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.430873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.431144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.431411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.432055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.433933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.456121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 953/1920] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:23.463791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.481912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d3bc5-d545-4078-9eaa-c1e4d0f44388 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.487522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.489254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.507494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.507494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.508475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.508804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.509503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.517710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.544391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 968/1921] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:23.547724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.551319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.579194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:23.581204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3224-bfbd-4d89-a453-fbb7bf277d35 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.599506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.607201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.607201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.607201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] PATH_INFO: `/v3/projects/2136bd9386924e8a8c6d8f9792458c41` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.608512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2136bd9386924e8a8c6d8f9792458c41)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.615264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.635846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0106f-c8ab-4e11-8161-8dcbeb47bbe5 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.649705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.650476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.650849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.651227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.661711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.752939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.754458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.778444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:23.784458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 954/1922] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:23.785432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.797168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011396bb-1871-49dc-8c14-d11c42a6ab65 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.801301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2136bd9386924e8a8c6d8f9792458c41', 'request_id': 'req-7b244d51-5bdf-4124-9311-3401eac7d32b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.813494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2136bd9386924e8a8c6d8f9792458c41', 'request_id': 'req-7b244d51-5bdf-4124-9311-3401eac7d32b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.821364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2136bd9386924e8a8c6d8f9792458c41', 'request_id': 'req-7b244d51-5bdf-4124-9311-3401eac7d32b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.881789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.882585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.882959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.883880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] PATH_INFO: `/v3/projects/738fb5cf8731481686d43596a3b64fe5/users/6b36506349dd466ba0ac0b9949363dca/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.902021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=738fb5cf8731481686d43596a3b64fe5, user_id=6b36506349dd466ba0ac0b9949363dca, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.904798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:23.910904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] The token cache is being invalidate because project 2136bd9386924e8a8c6d8f9792458c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:23.911196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.912110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:23.914530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 969/1923] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:23 2022] DELETE /identity/v3/projects/2136bd9386924e8a8c6d8f9792458c41 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:23.915273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:23.918277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:23.931699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b244d51-5bdf-4124-9311-3401eac7d32b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:23.936708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:23.937351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:23.937754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:23.938037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] PATH_INFO: `/v3/projects/3394c1879fba41198c886399963ff974` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:23.939166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3394c1879fba41198c886399963ff974)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:23.941143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.011193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 955/1924] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:23 2022] PUT /identity/v3/projects/738fb5cf8731481686d43596a3b64fe5/users/6b36506349dd466ba0ac0b9949363dca/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:24.011193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.013162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.085793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3394c1879fba41198c886399963ff974', 'request_id': 'req-af1f4d10-3120-4e88-a314-69fd354b785e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.096775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c315b-b8ea-4756-9796-e59558d59846 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.096943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3394c1879fba41198c886399963ff974', 'request_id': 'req-af1f4d10-3120-4e88-a314-69fd354b785e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.109804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3394c1879fba41198c886399963ff974', 'request_id': 'req-af1f4d10-3120-4e88-a314-69fd354b785e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.113039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:24.158550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.159189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.159467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.159740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] PATH_INFO: `/v3/users/ac21ea9e668e42d1a071ee03b7b52622` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.160986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac21ea9e668e42d1a071ee03b7b52622)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.163192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.247275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] The token cache is being invalidate because project 3394c1879fba41198c886399963ff974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:24.247569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.248265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-af1f4d10-3120-4e88-a314-69fd354b785e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.250167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 970/1925] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:23 2022] DELETE /identity/v3/projects/3394c1879fba41198c886399963ff974 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:24.251378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5e83-28f9-4ca1-b975-55d8c952e2c3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.251688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5e83-28f9-4ca1-b975-55d8c952e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.252706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc5e83-28f9-4ca1-b975-55d8c952e2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.282402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-98dc5e83-28f9-4ca1-b975-55d8c952e2c3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:24.282402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-98dc5e83-28f9-4ca1-b975-55d8c952e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.285466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 971/1926] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:24.287073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.287819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.288119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.316002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:24.317286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.332849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 972/1927] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:24.332849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.332849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.370106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac21ea9e668e42d1a071ee03b7b52622'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.371574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac21ea9e668e42d1a071ee03b7b52622'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.372931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac21ea9e668e42d1a071ee03b7b52622'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.382633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac21ea9e668e42d1a071ee03b7b52622'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.398542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac21ea9e668e42d1a071ee03b7b52622'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:24.410028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a600fb-fe5d-4cab-a396-9ed7bf71a639 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.414944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.415590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.415863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.419204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.419204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.431605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.433064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865b411-5510-4519-8538-f6a617ed4959 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.444962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 973/1928] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:24.448273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.448273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.448273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.471172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:24.475776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:24.481155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 956/1929] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:24 2022] DELETE /identity/v3/users/ac21ea9e668e42d1a071ee03b7b52622 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:24.487001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 974/1930] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:24.491669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.629903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c838bcc-5451-4731-96c7-6705d846b7bf admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.637870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.638835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.639288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.639910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.640810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:24.641280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.644353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.691589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 957/1931] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:24.696560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.709147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980761f-dda5-46e9-a05e-e2fb476e0d8d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.715698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.716367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.716668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.717043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.717711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.720283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:24.811795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 975/1932] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:24.815770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:24.831278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d588919-c09d-4e8e-b6d5-2627ba25f029 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:24.894978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:24.938221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:24.939081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:24.940414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:24.940771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:24.941649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:24.944235 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.031051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 958/1933] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:24 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:25.036520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.054042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b48a-3113-43c6-8866-a2766add6dfe admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.060232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.060976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.061495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.061870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.062629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.064939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.066876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:25.079675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 976/1934] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:25.083759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.096903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040fb52e-5623-4245-a6a8-032aac9cb455 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.107689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.108562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.108941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.109377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.110291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.112310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.126183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 959/1935] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:25.134167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.134624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.136890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.147983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d79521-b0f2-4351-a1b2-aa16271c907e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.158256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80e16-2c81-483a-9775-25f91a193023 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.165664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.168242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.168763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151ad27-300a-4d9f-82ec-3220ba9e64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.168892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.169059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] PATH_INFO: `/v3/projects/ed82fc3edbbb4e9b8779968fc6bfaaf1` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.169453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151ad27-300a-4d9f-82ec-3220ba9e64b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.169730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151ad27-300a-4d9f-82ec-3220ba9e64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.171854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151ad27-300a-4d9f-82ec-3220ba9e64b3 admin admin] PATH_INFO: `/v3/projects/453749bcd76f46bd98af525907aeacb6/users/5381314037da42a99bec53e9fde6f5f8/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.176537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed82fc3edbbb4e9b8779968fc6bfaaf1)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.179148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.220916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151ad27-300a-4d9f-82ec-3220ba9e64b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453749bcd76f46bd98af525907aeacb6, user_id=5381314037da42a99bec53e9fde6f5f8, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.223972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151ad27-300a-4d9f-82ec-3220ba9e64b3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.359985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 977/1936] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:25 2022] PUT /identity/v3/projects/453749bcd76f46bd98af525907aeacb6/users/5381314037da42a99bec53e9fde6f5f8/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:25.371524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67a24-9742-4780-8722-e64867e63349 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.371708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67a24-9742-4780-8722-e64867e63349 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.371930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e67a24-9742-4780-8722-e64867e63349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.383012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed82fc3edbbb4e9b8779968fc6bfaaf1', 'request_id': 'req-5877a567-47ab-449b-bbd8-0b33f83c9dee'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:25.403310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-68e67a24-9742-4780-8722-e64867e63349 None None] MFA Rules not processed for user `5381314037da42a99bec53e9fde6f5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:25.404864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-68e67a24-9742-4780-8722-e64867e63349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.418601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed82fc3edbbb4e9b8779968fc6bfaaf1', 'request_id': 'req-5877a567-47ab-449b-bbd8-0b33f83c9dee'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:25.437016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed82fc3edbbb4e9b8779968fc6bfaaf1', 'request_id': 'req-5877a567-47ab-449b-bbd8-0b33f83c9dee'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:25.505107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] The token cache is being invalidate because project ed82fc3edbbb4e9b8779968fc6bfaaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:25.505461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:25.506458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5877a567-47ab-449b-bbd8-0b33f83c9dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:25.510000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 960/1937] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:25 2022] DELETE /identity/v3/projects/ed82fc3edbbb4e9b8779968fc6bfaaf1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:25.514500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3924ef-2dba-47a0-b4e9-ed16dea2ea22 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.514779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3924ef-2dba-47a0-b4e9-ed16dea2ea22 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.515048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3924ef-2dba-47a0-b4e9-ed16dea2ea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.518982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 978/1938] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:25.524466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67a24-9742-4780-8722-e64867e63349 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.552671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4a3924ef-2dba-47a0-b4e9-ed16dea2ea22 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:25.554998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4a3924ef-2dba-47a0-b4e9-ed16dea2ea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.616126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e67a24-9742-4780-8722-e64867e63349 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.627099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.627815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.630203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.630203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.630203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.632179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.657402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 961/1939] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:25.665938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.666411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.673319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.696291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:25.700244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.713054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 962/1940] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:25.714915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.725953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29d89f-5d26-4a8f-a55c-d1b2b30dd2cd None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.736209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.736838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.737203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.737498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.738154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:25.738460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.740093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.752402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 963/1941] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:25.760816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.769559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 979/1942] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:25.776458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dad6a2-963a-495c-90e8-9f0a0a157933 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.791253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:25.793721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:25.891881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.892720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.893030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.893270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.893913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.896580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:25.963802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72454e6f-411f-4c5a-b4f4-6e7686a1d96f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:25.968748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:25.969375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:25.970197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:25.970197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:25.970790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:25.974272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.040892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 964/1943] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:26.045402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.075049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 980/1944] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:25 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:26.076154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.088011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3dd7c9-cb1f-45de-9994-38e276957371 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.091338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:26.137752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ef5aa-f2da-40cb-8204-94c80e276395 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.142975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe3230-cdfa-4d9e-b32c-249811ad9f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.143625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe3230-cdfa-4d9e-b32c-249811ad9f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.143921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe3230-cdfa-4d9e-b32c-249811ad9f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.144246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe3230-cdfa-4d9e-b32c-249811ad9f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.144910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe3230-cdfa-4d9e-b32c-249811ad9f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.150325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe3230-cdfa-4d9e-b32c-249811ad9f6d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.385008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.385008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.385008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.385008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.386550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.386550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.386550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 981/1945] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:26.386550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.386550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f8f4d-b473-4647-80c0-016f73d391ec admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.387273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.387273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.387273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.387273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] PATH_INFO: `/v3/projects/a716d959277f428d8a8b6b9cd912b765/users/b5ba43d5d0604f9b9269dcf23dd8c139/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.401939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a716d959277f428d8a8b6b9cd912b765, user_id=b5ba43d5d0604f9b9269dcf23dd8c139, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.404691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.649392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 965/1946] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:26 2022] POST /identity/v3/users => generated 288 bytes in 593 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:26.650888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 982/1947] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:26 2022] PUT /identity/v3/projects/a716d959277f428d8a8b6b9cd912b765/users/b5ba43d5d0604f9b9269dcf23dd8c139/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:26.650986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10571dc6-865a-400f-b075-15e034f039ff None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.650986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10571dc6-865a-400f-b075-15e034f039ff None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.650986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10571dc6-865a-400f-b075-15e034f039ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.651228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.682101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-10571dc6-865a-400f-b075-15e034f039ff None None] MFA Rules not processed for user `6b36506349dd466ba0ac0b9949363dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:26.683332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-10571dc6-865a-400f-b075-15e034f039ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:26.723300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622c97c-b57b-4fc0-bf90-a43d52a5c151 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.728002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.728640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.728917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.729186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.729828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.731415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.743017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 983/1948] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:26.743861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.753995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 966/1949] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:26.756116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60cbfc-2d10-483d-9b8c-a1bae6da6347 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.756248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10571dc6-865a-400f-b075-15e034f039ff None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.761800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.762571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.762916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.763250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.763953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.765741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.766798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10571dc6-865a-400f-b075-15e034f039ff None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.772691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.779179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.779179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.779179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] PATH_INFO: `/v3/projects/a716d959277f428d8a8b6b9cd912b765/users/b5ba43d5d0604f9b9269dcf23dd8c139/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.779179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a716d959277f428d8a8b6b9cd912b765, user_id=b5ba43d5d0604f9b9269dcf23dd8c139, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.779583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 984/1950] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:26.779666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.783066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.784771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:26.790700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 967/1951] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:26 2022] PUT /identity/v3/projects/a716d959277f428d8a8b6b9cd912b765/users/b5ba43d5d0604f9b9269dcf23dd8c139/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:26.799165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:26.805423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a1442-6e8a-42b4-b974-7c8c45d92f28 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.867002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.867620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.867895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.868232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.869465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.872173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.874882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342220f8-b4d9-4ee3-9318-8b265b0d4a0b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:26.885986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c2aaa-e4e5-4648-b31d-88ff090071a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:26.888183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c2aaa-e4e5-4648-b31d-88ff090071a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.888183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c2aaa-e4e5-4648-b31d-88ff090071a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.888183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c2aaa-e4e5-4648-b31d-88ff090071a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.888710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c2aaa-e4e5-4648-b31d-88ff090071a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:26.890387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2c2aaa-e4e5-4648-b31d-88ff090071a8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:26.900833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 968/1952] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:26.902130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:26.902422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:26.902698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:26.935815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] MFA Rules not processed for user `b5ba43d5d0604f9b9269dcf23dd8c139`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:26.937047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:26.980424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:26.987882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 985/1953] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:26 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:26.989378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.011898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 969/1954] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:27.018165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.022830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7866450-46f0-4eee-a66b-616ae09edac2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.057939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9acbec-a75c-4a5c-9600-84aff4924562 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.063073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.064051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.064051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.064362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] PATH_INFO: `/v3/projects/4461cfaf2c4642278ce5c9e4acd908a0/users/132b9a695360425d9a2902f90fb9a6e1/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.080975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461cfaf2c4642278ce5c9e4acd908a0, user_id=132b9a695360425d9a2902f90fb9a6e1, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.083696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.087844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9c14d-3fd5-4445-887d-1fed70a99f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.088522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c14d-3fd5-4445-887d-1fed70a99f07 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.088838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c14d-3fd5-4445-887d-1fed70a99f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.089111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9c14d-3fd5-4445-887d-1fed70a99f07 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.089746 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9c14d-3fd5-4445-887d-1fed70a99f07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.091658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9c14d-3fd5-4445-887d-1fed70a99f07 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.174394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 986/1955] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:26 2022] PUT /identity/v3/projects/4461cfaf2c4642278ce5c9e4acd908a0/users/132b9a695360425d9a2902f90fb9a6e1/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:27.175119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.176731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:27.196928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 970/1956] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:27 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:27.198529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.198812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.199084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.242701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] MFA Rules not processed for user `132b9a695360425d9a2902f90fb9a6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:27.243922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:27.255573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b2c0e-fb38-4c12-9991-b04da956cb59 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.259771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.260438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.260705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.260975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.318183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 971/1957] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:27.319111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.330992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.333629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.350804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 987/1958] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:27.350804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.408703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32acfc0-2ba0-40ac-aee3-732f5ff7be5c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.414911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.415780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.415899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.416261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.417036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.418716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.419632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8dad-4657-41b9-afee-ab0a3c9bc7c5 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.424890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.425242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.425518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.425964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.426500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.429501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.431282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 972/1959] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:27.437935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.449312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81afa74-c937-4a0a-81e8-e4368013fb2a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.454417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.455054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.455454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.455742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] PATH_INFO: `/v3/users/5381314037da42a99bec53e9fde6f5f8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.457063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5381314037da42a99bec53e9fde6f5f8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.459020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.535233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 988/1960] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:27 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:27.536245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.586406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5381314037da42a99bec53e9fde6f5f8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:27.587338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5381314037da42a99bec53e9fde6f5f8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:27.587963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5381314037da42a99bec53e9fde6f5f8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:27.594819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5381314037da42a99bec53e9fde6f5f8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:27.604218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e849a6e-3c88-45a4-9170-297a158aa2c9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.607054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5381314037da42a99bec53e9fde6f5f8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:27.608995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f850-af41-4697-a041-f702d00fc55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.609641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f850-af41-4697-a041-f702d00fc55a admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.609918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f850-af41-4697-a041-f702d00fc55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.610191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f850-af41-4697-a041-f702d00fc55a admin admin] PATH_INFO: `/v3/projects/224e9fe5d3f64a25b0086190310c02ca/users/6f70a011f41248bb924a74a7144abebf/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.625612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f850-af41-4697-a041-f702d00fc55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=224e9fe5d3f64a25b0086190310c02ca, user_id=6f70a011f41248bb924a74a7144abebf, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.628370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f850-af41-4697-a041-f702d00fc55a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.709899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 973/1961] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:27 2022] DELETE /identity/v3/users/5381314037da42a99bec53e9fde6f5f8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:27.710745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.712130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:27.733493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 989/1962] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:27 2022] PUT /identity/v3/projects/224e9fe5d3f64a25b0086190310c02ca/users/6f70a011f41248bb924a74a7144abebf/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:27.734843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.735125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.735397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.755078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:27.756324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:27.776298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e042e5-553d-48ea-90d9-8d2d9ec09dac admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.815655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 990/1963] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:27.816819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.818096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:27.830462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70a1e0-cdd9-4360-8cf5-fa8866474f0b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.834982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.835143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.835582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.835706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.835861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.836011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.836149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.836319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.836783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.836942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.838376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.838853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.848970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 991/1964] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:27.849822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.851797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:27.909326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c0013-e75c-4d2e-a7b3-1931ba7364b9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.914090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.914739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.915017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.915287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.929128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.929128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.929402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 974/1965] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:27 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:27.929402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.936496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 992/1966] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:27.937356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.946891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b0ca-3a37-4811-90d9-6a5a499871a8 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.952385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f58b7b-3fbc-42df-a74f-9a089b871eba admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.952540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.952540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.952540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.953024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.953448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.955064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.957202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:27.958239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:27.958606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:27.958981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] PATH_INFO: `/v3/projects/224e9fe5d3f64a25b0086190310c02ca/users/6f70a011f41248bb924a74a7144abebf/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:27.961142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=224e9fe5d3f64a25b0086190310c02ca, user_id=6f70a011f41248bb924a74a7144abebf, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:27.969440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:27.969734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 993/1967] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:27.970053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:27.976608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 975/1968] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:27 2022] PUT /identity/v3/projects/224e9fe5d3f64a25b0086190310c02ca/users/6f70a011f41248bb924a74a7144abebf/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:27.983188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ef48-8d88-4895-b04a-ea7848ffe3a6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:27.986728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:28.048896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:28.049566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.049941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.050216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] PATH_INFO: `/v3/projects/6a1b172fa488478d84286cb327705fd1/users/849a44d229dc42ada269bbc08a7b8438/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.058747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:28.066543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1b172fa488478d84286cb327705fd1, user_id=849a44d229dc42ada269bbc08a7b8438, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:28.069368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:28.138056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 994/1969] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:27 2022] PUT /identity/v3/projects/6a1b172fa488478d84286cb327705fd1/users/849a44d229dc42ada269bbc08a7b8438/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:28.142298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:28.156991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc9e93-7e52-4f9a-895d-68ebff376bdd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:28.217137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092834-9ba0-433d-a461-1240b32eec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:28.217817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092834-9ba0-433d-a461-1240b32eec8f admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.218097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092834-9ba0-433d-a461-1240b32eec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.218384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092834-9ba0-433d-a461-1240b32eec8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.219160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092834-9ba0-433d-a461-1240b32eec8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:28.220825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092834-9ba0-433d-a461-1240b32eec8f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:28.231851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 976/1970] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:28.236570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:28.248866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9978f-7353-4301-bbf4-4bb30147ad81 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:28.253818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624916-5953-4546-b301-920767746b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:28.254377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624916-5953-4546-b301-920767746b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.254769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624916-5953-4546-b301-920767746b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.255058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef624916-5953-4546-b301-920767746b2c admin admin] PATH_INFO: `/v3/projects/6a1b172fa488478d84286cb327705fd1/users/849a44d229dc42ada269bbc08a7b8438/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.257484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef624916-5953-4546-b301-920767746b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1b172fa488478d84286cb327705fd1, user_id=849a44d229dc42ada269bbc08a7b8438, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:28.261288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef624916-5953-4546-b301-920767746b2c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:28.283001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 995/1971] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:28 2022] PUT /identity/v3/projects/6a1b172fa488478d84286cb327705fd1/users/849a44d229dc42ada269bbc08a7b8438/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:28.295365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.295827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.296277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.332046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] MFA Rules not processed for user `849a44d229dc42ada269bbc08a7b8438`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:28.333283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:28.426395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 977/1972] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:28.437556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624916-5953-4546-b301-920767746b2c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:28.439903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ef624916-5953-4546-b301-920767746b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:28.478793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:28.480423 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:28.515583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef624916-5953-4546-b301-920767746b2c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:28.520122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:28.520899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.521205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.521645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.525970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:28.603930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958013c-4643-46df-8c36-2d80ab5f42b0 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:28.619036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:28.619929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:28.621157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:28.621507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] PATH_INFO: `/v3/projects/453749bcd76f46bd98af525907aeacb6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:28.624469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453749bcd76f46bd98af525907aeacb6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:28.626565 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:28.636279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:28.641509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:28.643555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:28.657917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 996/1973] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:28.767718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:28.817799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453749bcd76f46bd98af525907aeacb6', 'request_id': 'req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.828118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453749bcd76f46bd98af525907aeacb6', 'request_id': 'req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.835938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453749bcd76f46bd98af525907aeacb6', 'request_id': 'req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.968057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] The token cache is being invalidate because project 453749bcd76f46bd98af525907aeacb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:28.968660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.969521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-06aa03d9-4a16-4966-a7ac-0e5e9b3c5b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:28.973817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 978/1974] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:28 2022] DELETE /identity/v3/projects/453749bcd76f46bd98af525907aeacb6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:28.975441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:28.986664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991324fc-1d1a-4f3e-8eb2-67fa73d36e85 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:29.056849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:29.057495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.057767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.058033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] PATH_INFO: `/v3/users/b5ba43d5d0604f9b9269dcf23dd8c139` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.059174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ba43d5d0604f9b9269dcf23dd8c139)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:29.061132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:29.288482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ba43d5d0604f9b9269dcf23dd8c139'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.289144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ba43d5d0604f9b9269dcf23dd8c139'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.296188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ba43d5d0604f9b9269dcf23dd8c139'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.308484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ba43d5d0604f9b9269dcf23dd8c139'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.309194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e5634982-77e9-45ca-9913-76001a66e691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ba43d5d0604f9b9269dcf23dd8c139'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:29.337916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.338279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.338695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.379576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] MFA Rules not processed for user `6f70a011f41248bb924a74a7144abebf`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:29.380860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.423251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 997/1975] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:28 2022] DELETE /identity/v3/users/b5ba43d5d0604f9b9269dcf23dd8c139 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:29.477389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 979/1976] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:29.485846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.486355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.486549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.515905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] MFA Rules not processed for user `6b36506349dd466ba0ac0b9949363dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:29.517363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.533910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:29.582724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 998/1977] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:29.594612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:29.596066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.646308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:29.715875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc2848-9a86-414b-b0d1-47790fb050ca None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:29.795940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:29.796620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.796895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.797162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.798965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.811564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:29.813192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cc198-ea0d-43d8-be05-176663504a9b service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:29.825972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 980/1978] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:29.899255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:29.903682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:29.981913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdea343-6084-4d24-82b6-531649ef56bd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:29.987049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:29.987765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:29.988313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:29.988681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] PATH_INFO: `/v3/projects/a716d959277f428d8a8b6b9cd912b765` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:29.989818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a716d959277f428d8a8b6b9cd912b765)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:29.992372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.106490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a716d959277f428d8a8b6b9cd912b765', 'request_id': 'req-5518fe95-3807-4344-b8fd-78fefa64d3c1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.113034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a716d959277f428d8a8b6b9cd912b765', 'request_id': 'req-5518fe95-3807-4344-b8fd-78fefa64d3c1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.119251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a716d959277f428d8a8b6b9cd912b765', 'request_id': 'req-5518fe95-3807-4344-b8fd-78fefa64d3c1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.208206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] The token cache is being invalidate because project a716d959277f428d8a8b6b9cd912b765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:30.208504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.209212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5518fe95-3807-4344-b8fd-78fefa64d3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:30.210888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 999/1979] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:29 2022] DELETE /identity/v3/projects/a716d959277f428d8a8b6b9cd912b765 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:30.216727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.217234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.217331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.237686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:30.238882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:30.254267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:30.306456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 981/1980] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:30.314864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.315205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.315488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.336002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:30.337267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:30.345437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1000/1981] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:30.350641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.360290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9ec20-89ed-40af-85e1-bfdb497267ed None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.365360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.366695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.370494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.370494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.370494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:30.370494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.370494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.382239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 982/1982] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:30.386635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.396185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663b309-d391-4b90-b82a-88623ed2190d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.400970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.401575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.401849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.402117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.402763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.404999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.546329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1001/1983] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:30.550844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.561988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c10938-e6c9-418a-a371-e3bf1169f3ad admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.623122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.623758 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.624036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.624338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.624995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.627057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.742335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:30.747942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 983/1984] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:30 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:30.752614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.763719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd184e19-7fb7-4a70-a72c-e9f5fa595e2d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.768617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.769227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.769497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.769761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.770401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.772130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.782628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1002/1985] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:30.790222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.798289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302c82f-efea-4f7a-9c2e-4d1f4b355740 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.803150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974aff7e-800f-4c17-9e2a-3601666823e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.804436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aff7e-800f-4c17-9e2a-3601666823e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.804849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aff7e-800f-4c17-9e2a-3601666823e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.805210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974aff7e-800f-4c17-9e2a-3601666823e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.806013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aff7e-800f-4c17-9e2a-3601666823e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.807803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974aff7e-800f-4c17-9e2a-3601666823e5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:30.826094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 984/1986] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:30.830172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:30.841193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fb39c-e732-446c-a7d8-21ee6eba7c38 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:30.851199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:30.854927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:30.855416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:30.855886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] PATH_INFO: `/v3/projects/173fb469b5a7422f8654240e976bf49b/users/6d83b095cee345e09b8794a6ce527464/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:30.886818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=173fb469b5a7422f8654240e976bf49b, user_id=6d83b095cee345e09b8794a6ce527464, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:30.890911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.005135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:31.011704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1003/1987] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:30 2022] PUT /identity/v3/projects/173fb469b5a7422f8654240e976bf49b/users/6d83b095cee345e09b8794a6ce527464/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:31.025126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.025843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.026215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.067390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] MFA Rules not processed for user `6d83b095cee345e09b8794a6ce527464`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:31.068998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.076915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.079568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.185359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c99e0d-1970-41f4-80a7-5e091b63fcdb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.191700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.192052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 985/1988] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:31.192477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.192820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.193100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] PATH_INFO: `/v3/users/f87eb6ae1f7045098cc2798e1f77565f` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.194286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87eb6ae1f7045098cc2798e1f77565f)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.196381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.197038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.213077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bfa5a-9aee-41ec-ab62-0f6f56e2442b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.220201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.221852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.222382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.222923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.224066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.227686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.288973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:31.307061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 986/1989] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:31.314752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.349732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87eb6ae1f7045098cc2798e1f77565f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:31.351016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87eb6ae1f7045098cc2798e1f77565f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:31.364630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87eb6ae1f7045098cc2798e1f77565f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:31.378553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87eb6ae1f7045098cc2798e1f77565f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:31.379561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-91a1fe8f-70d1-4086-9397-fbae70bb3b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87eb6ae1f7045098cc2798e1f77565f'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:31.390360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b83a3-0da8-42ee-81b7-24740d7ffe16 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.395381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.396137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.396553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.396825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.397955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.399876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.483982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1004/1990] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:31 2022] DELETE /identity/v3/users/f87eb6ae1f7045098cc2798e1f77565f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:31.488220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.488504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.488775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.504176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 987/1991] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:31.508025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.509970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.510540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:31.512392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.524903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c1cce-e840-4911-baed-8606d0c2ac99 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.598285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1005/1992] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:31.606357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.607110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.610797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.611747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.612319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.612752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.613838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.615607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.636395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 988/1993] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:31.638048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.657146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290fa7a-b306-48bb-a59f-92d1c81dd59b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.663468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.664192 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.664471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.664742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.665394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.667193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.685983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 989/1994] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:31.690189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:31.700795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933970c-3d43-4c4f-b2b4-ebb6c54a56b3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.706137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.706797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.707068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.707339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] PATH_INFO: `/v3/projects/db441a8baf324ec1a50e109a83983903/users/3b5ee3780e1c4b3cb77c21dad4824178/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.707991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17636-8115-4f99-9689-cb471beac0fd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:31.712395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb588c0-0aeb-4960-ac7e-29782f6e14f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:31.713081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb588c0-0aeb-4960-ac7e-29782f6e14f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.713409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb588c0-0aeb-4960-ac7e-29782f6e14f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.714065 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb588c0-0aeb-4960-ac7e-29782f6e14f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.722881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db441a8baf324ec1a50e109a83983903, user_id=3b5ee3780e1c4b3cb77c21dad4824178, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.723518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb588c0-0aeb-4960-ac7e-29782f6e14f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:31.724965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb588c0-0aeb-4960-ac7e-29782f6e14f8 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.726437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:31.735869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1006/1995] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:31.791154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:31.797196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 990/1996] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:31 2022] PUT /identity/v3/projects/db441a8baf324ec1a50e109a83983903/users/3b5ee3780e1c4b3cb77c21dad4824178/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:31.807850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07041-87e7-419b-af36-0964469c694e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:31.808163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07041-87e7-419b-af36-0964469c694e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:31.808440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b07041-87e7-419b-af36-0964469c694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:31.841260 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b4b07041-87e7-419b-af36-0964469c694e None None] MFA Rules not processed for user `3b5ee3780e1c4b3cb77c21dad4824178`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:31.842660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b4b07041-87e7-419b-af36-0964469c694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:31.927910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1007/1997] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:31.933301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.034948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3ec49-6af3-41f0-9902-8e341f603010 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.042640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.043177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.043520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.043714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.044546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.047147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.147719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 991/1998] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:31 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:32.152549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b07041-87e7-419b-af36-0964469c694e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.166462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b07041-87e7-419b-af36-0964469c694e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.184836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:32.223295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.226330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.247286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.248372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.248863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.249386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.250538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.254360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.326342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3693fe-2749-4952-bb61-1802e05163bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.330934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.331555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.331824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.332114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] PATH_INFO: `/v3/projects/e9c184bde1c147528715a3dd96359fd5` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.333368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c184bde1c147528715a3dd96359fd5)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.335869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.374112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1008/1999] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:32 2022] POST /identity/v3/users => generated 296 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:32.377989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.387892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f10784-5012-4996-bf8c-7ae1665553ae admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.392702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.393293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.393566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.394155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.394578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.396071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.407323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1009/2000] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:32.411609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.421495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb996cd-f468-45cf-8859-925a1aa70431 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.431183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.431183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.431183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.431183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] PATH_INFO: `/v3/projects/b92895a4f352405e83227a62383e3b77/users/fc3e5c4d57f64277b562f7bc0dc4d4ef/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.446352 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92895a4f352405e83227a62383e3b77, user_id=fc3e5c4d57f64277b562f7bc0dc4d4ef, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.447595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:32.449300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.468729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c184bde1c147528715a3dd96359fd5', 'request_id': 'req-534d93ec-38f9-415a-827e-b3065b57d3be'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:32.475520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c184bde1c147528715a3dd96359fd5', 'request_id': 'req-534d93ec-38f9-415a-827e-b3065b57d3be'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:32.481528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c184bde1c147528715a3dd96359fd5', 'request_id': 'req-534d93ec-38f9-415a-827e-b3065b57d3be'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:32.522936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:32.533951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1010/2001] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:32 2022] PUT /identity/v3/projects/b92895a4f352405e83227a62383e3b77/users/fc3e5c4d57f64277b562f7bc0dc4d4ef/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:32.540974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.569558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] The token cache is being invalidate because project e9c184bde1c147528715a3dd96359fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:32.569847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:32.570503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:32.572381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 992/2002] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:32 2022] DELETE /identity/v3/projects/e9c184bde1c147528715a3dd96359fd5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:32.576000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.578536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.611038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e937bde-4d3c-4325-ba5d-9b5ddb24ee47 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.616531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.617195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.617463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.617727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.618364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.620072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.631622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1011/2003] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:32.635879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.637660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.651586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e2ad8-ad43-4953-b9f8-62befc4849e8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.656772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c7ce2-d684-431e-9513-d979c69a707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.657476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7ce2-d684-431e-9513-d979c69a707d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.657787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7ce2-d684-431e-9513-d979c69a707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.658068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c7ce2-d684-431e-9513-d979c69a707d admin admin] PATH_INFO: `/v3/projects/b92895a4f352405e83227a62383e3b77/users/fc3e5c4d57f64277b562f7bc0dc4d4ef/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.660305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7ce2-d684-431e-9513-d979c69a707d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92895a4f352405e83227a62383e3b77, user_id=fc3e5c4d57f64277b562f7bc0dc4d4ef, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.669827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c7ce2-d684-431e-9513-d979c69a707d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.675324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1012/2004] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:32 2022] PUT /identity/v3/projects/b92895a4f352405e83227a62383e3b77/users/fc3e5c4d57f64277b562f7bc0dc4d4ef/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:32.683583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d93ec-38f9-415a-827e-b3065b57d3be admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.686009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.686293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.686564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.717846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] MFA Rules not processed for user `fc3e5c4d57f64277b562f7bc0dc4d4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:32.719080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.746580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:32.754289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.754289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.754289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.754655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] PATH_INFO: `/v3/users/5b2ed445f8024530a7089122235d48fd` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.755658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2ed445f8024530a7089122235d48fd)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.757904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.795298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1013/2005] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:32.806572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.808277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.870700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada8e08-1700-42e8-9e58-8e3b3158604b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.880253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.880768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.881118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.881482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.892269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.894925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.906625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1014/2006] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:32.967295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:32.969459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:32.984139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed45f32-e3c4-4eb3-afee-56f15217a40a service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:32.989166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:32.989933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:32.990321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:32.990690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] PATH_INFO: `/v3/users/132b9a695360425d9a2902f90fb9a6e1` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:32.991974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=132b9a695360425d9a2902f90fb9a6e1)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:32.993314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2ed445f8024530a7089122235d48fd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:32.994152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:32.994519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2ed445f8024530a7089122235d48fd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.001877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:33.003452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2ed445f8024530a7089122235d48fd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.018922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2ed445f8024530a7089122235d48fd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.034693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2ed445f8024530a7089122235d48fd'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.064476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:33.099149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 993/2007] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:32 2022] DELETE /identity/v3/users/5b2ed445f8024530a7089122235d48fd => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:33.102969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:33.104151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:33.178739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6766f-5e86-49e1-aa76-aded7d9afdad admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:33.180545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:33.181304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:33.181587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:33.181858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:33.186196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:33.187213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132b9a695360425d9a2902f90fb9a6e1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.190238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132b9a695360425d9a2902f90fb9a6e1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.213566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132b9a695360425d9a2902f90fb9a6e1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.234354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132b9a695360425d9a2902f90fb9a6e1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.235561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132b9a695360425d9a2902f90fb9a6e1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.265918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:33.267559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb59e6-4f25-483f-839b-8e2232aa5252 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:33.277280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:33.278956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 994/2008] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:33.315759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1015/2009] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:32 2022] DELETE /identity/v3/users/132b9a695360425d9a2902f90fb9a6e1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:33.321217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:33.321841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:33.322123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:33.378782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:33.380062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:33.488315 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:33.489297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 995/2010] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:33.502446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:33.505453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:33.591829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978eb58-e6f7-46b6-9cf0-16f3d39f2cea admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:33.595134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96263f0-3bef-484b-b47c-6c98c5377a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:33.597097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96263f0-3bef-484b-b47c-6c98c5377a94 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:33.597097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96263f0-3bef-484b-b47c-6c98c5377a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:33.597097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96263f0-3bef-484b-b47c-6c98c5377a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:33.606015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96263f0-3bef-484b-b47c-6c98c5377a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:33.607423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96263f0-3bef-484b-b47c-6c98c5377a94 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:33.618673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1016/2011] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:33.689121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:33.690906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:33.704814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da77682-2e16-4ce1-a88a-83ec76adb973 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:33.709676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:33.710319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:33.710598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:33.710871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] PATH_INFO: `/v3/projects/8029995fead64a8ab22d79a170fb411c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:33.712006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8029995fead64a8ab22d79a170fb411c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:33.714009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:33.881252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8029995fead64a8ab22d79a170fb411c', 'request_id': 'req-43f4edad-94c2-4048-b599-4d3d86fefb75'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.890230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8029995fead64a8ab22d79a170fb411c', 'request_id': 'req-43f4edad-94c2-4048-b599-4d3d86fefb75'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.898892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8029995fead64a8ab22d79a170fb411c', 'request_id': 'req-43f4edad-94c2-4048-b599-4d3d86fefb75'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.973491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] The token cache is being invalidate because project 8029995fead64a8ab22d79a170fb411c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:33.976323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.976323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-43f4edad-94c2-4048-b599-4d3d86fefb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:33.977003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 996/2012] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:33 2022] DELETE /identity/v3/projects/8029995fead64a8ab22d79a170fb411c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:33.982991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:33.983276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:33.983552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.007860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:34.009099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:34.069320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1017/2013] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:34.077859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.078141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.078425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.092303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.094034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:34.102207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:34.103993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:34.110748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65649d-9d6b-4cb2-9d68-8fd2fb18799e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.115334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 997/2014] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:34.117069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.118684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.118815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.119058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.119329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] PATH_INFO: `/v3/projects/4461cfaf2c4642278ce5c9e4acd908a0` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.121095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4461cfaf2c4642278ce5c9e4acd908a0)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.123591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.128105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7a36-9e0a-4a26-b4cc-4934c592272f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.133890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.134472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.134788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.135007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.135657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:34.135943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.141882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.176415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:34.176524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 998/2015] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:34.176722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.192475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd05fd-5c18-43e5-a749-7aa529044972 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.197882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.198557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.198839 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.199110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.201167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.201825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.297387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4461cfaf2c4642278ce5c9e4acd908a0', 'request_id': 'req-a52baf2e-93d7-433b-8c20-690a89f656b3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.307682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4461cfaf2c4642278ce5c9e4acd908a0', 'request_id': 'req-a52baf2e-93d7-433b-8c20-690a89f656b3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.314966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4461cfaf2c4642278ce5c9e4acd908a0', 'request_id': 'req-a52baf2e-93d7-433b-8c20-690a89f656b3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.355827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 999/2016] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:34 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:34.356984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.379244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] The token cache is being invalidate because project 4461cfaf2c4642278ce5c9e4acd908a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:34.379538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.380387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.383744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1018/2017] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:34 2022] DELETE /identity/v3/projects/4461cfaf2c4642278ce5c9e4acd908a0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:34.386527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.389105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:34.442605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:34.447868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddcf43-1bbb-4401-9ab8-ab58e2b993c0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.452874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.453534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.453806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.454075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.454699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.456750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.468955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52baf2e-93d7-433b-8c20-690a89f656b3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.475244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.475244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.475244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.475244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] PATH_INFO: `/v3/users/849a44d229dc42ada269bbc08a7b8438` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.476282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849a44d229dc42ada269bbc08a7b8438)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.478211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.569915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1000/2018] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:34 2022] POST /identity/v3/users => generated 281 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:34.573817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.575692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:34.589124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c9070-f976-4473-95d2-acf7355c62e9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.598290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.598290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.598290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.598290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.598675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.599259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.610012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1001/2019] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:34.613890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.625484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f229-e920-48f2-bc65-5f7743a1bf75 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.632254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.632871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.633149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.633419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.634063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.644278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.650353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1002/2020] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:34.654193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.668667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5df46-9563-497d-be18-6b76d7203965 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:34.673702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12cedf-c46b-4490-a1ed-06d15291eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:34.674723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12cedf-c46b-4490-a1ed-06d15291eda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.674723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12cedf-c46b-4490-a1ed-06d15291eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.675086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12cedf-c46b-4490-a1ed-06d15291eda0 admin admin] PATH_INFO: `/v3/projects/2b53bd0853434866b3d5a21072120cb4/users/b0af6cb0164a49dab9e464b14ad836bf/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.680724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849a44d229dc42ada269bbc08a7b8438'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.681614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849a44d229dc42ada269bbc08a7b8438'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.690572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849a44d229dc42ada269bbc08a7b8438'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.693017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12cedf-c46b-4490-a1ed-06d15291eda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b53bd0853434866b3d5a21072120cb4, user_id=b0af6cb0164a49dab9e464b14ad836bf, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:34.695850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12cedf-c46b-4490-a1ed-06d15291eda0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:34.703474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849a44d229dc42ada269bbc08a7b8438'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.704300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849a44d229dc42ada269bbc08a7b8438'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:34.784914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1003/2021] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:34 2022] PUT /identity/v3/projects/2b53bd0853434866b3d5a21072120cb4/users/b0af6cb0164a49dab9e464b14ad836bf/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:34.797756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:34.798043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:34.798318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:34.822516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1019/2022] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:34 2022] DELETE /identity/v3/users/849a44d229dc42ada269bbc08a7b8438 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:34.829610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] MFA Rules not processed for user `b0af6cb0164a49dab9e464b14ad836bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:34.830836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:34.944467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1004/2023] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:34.982839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:34.988110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.043001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:35.073098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8d219-8c0d-4614-a8c5-944d792d2c55 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.078149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.078780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.079056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.079328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.089852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.090900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.102811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1020/2024] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:35.130501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.132389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.216652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b0950-b99d-43c6-b373-ce4b9a4adbbd None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.223042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.224624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.225817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.226238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] PATH_INFO: `/v3/users/b0af6cb0164a49dab9e464b14ad836bf` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.228187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0af6cb0164a49dab9e464b14ad836bf)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.231351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.437962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:35.454038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0af6cb0164a49dab9e464b14ad836bf'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.455185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0af6cb0164a49dab9e464b14ad836bf'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.455782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0af6cb0164a49dab9e464b14ad836bf'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.463922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0af6cb0164a49dab9e464b14ad836bf'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.480857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f78fe329-952a-428c-8d99-acfe3747b42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0af6cb0164a49dab9e464b14ad836bf'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.501080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.503498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.519012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43a586-f753-45a3-9be8-e9eaef325ca6 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.525832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.526735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.527204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.527664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] PATH_INFO: `/v3/projects/6a1b172fa488478d84286cb327705fd1` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.529343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1b172fa488478d84286cb327705fd1)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.531730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.571485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1005/2025] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:35 2022] DELETE /identity/v3/users/b0af6cb0164a49dab9e464b14ad836bf => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:35.576835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.577254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.577625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.600019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:35.601516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.685090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1006/2026] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:35.695350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:35.698035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.699969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1b172fa488478d84286cb327705fd1', 'request_id': 'req-123ef724-3d70-45dc-8f0c-f61afa389536'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.711204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1b172fa488478d84286cb327705fd1', 'request_id': 'req-123ef724-3d70-45dc-8f0c-f61afa389536'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.719735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1b172fa488478d84286cb327705fd1', 'request_id': 'req-123ef724-3d70-45dc-8f0c-f61afa389536'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.775914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1142e5-760e-4ab7-8697-af546a736031 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:35.830555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deef953-e7cd-41e7-9147-cf1d4aa3e9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:35.831174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deef953-e7cd-41e7-9147-cf1d4aa3e9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.831544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deef953-e7cd-41e7-9147-cf1d4aa3e9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.831823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deef953-e7cd-41e7-9147-cf1d4aa3e9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.844276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] The token cache is being invalidate because project 6a1b172fa488478d84286cb327705fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:35.844927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.846450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-123ef724-3d70-45dc-8f0c-f61afa389536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:35.848794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1021/2027] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:35 2022] DELETE /identity/v3/projects/6a1b172fa488478d84286cb327705fd1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:35.857690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.858294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:35.858794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:35.887614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:35.889517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:35.924840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deef953-e7cd-41e7-9147-cf1d4aa3e9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:35.926375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deef953-e7cd-41e7-9147-cf1d4aa3e9e0 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:35.940245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1007/2028] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:35.991204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1022/2029] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:35.999258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:35.999686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.000072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.023701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:36.025162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.033928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1008/2030] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:36.039272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.049726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841fbc8-a9bf-4c91-9fd6-2f87153d95b9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.055880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.057392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.057672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.058203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.059031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:36.059760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.060979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.076133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1023/2031] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:36.080883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.090335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db0758-9a44-40fc-a7a7-263b1dce28cf None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.095645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.096268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.096763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.097027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.097703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.099941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.195779 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1009/2032] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:36 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:36.196309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.206652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88eb129-8d33-4e85-ac82-0f701df4b8c8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.253498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:36.273299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.274212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.274212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.274574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.275463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.277560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.380360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.394195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1024/2033] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:36 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:36.402012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5506766-33a1-4b81-973e-c5d1dd3727f5 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.434987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.434987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.434987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.434987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.435393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.435393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.442053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1010/2034] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:36.446586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.460422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fb24-49ba-4fea-981c-623c9f400db1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.465371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.466575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.466873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.467138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.468193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.470095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.486080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1025/2035] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:36.487783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.498778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57372c-ae60-4da9-a5d5-ce9bb77c4fff admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.504855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d85db-2de9-4b83-9d89-fe3c75476c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.505442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d85db-2de9-4b83-9d89-fe3c75476c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.505714 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d85db-2de9-4b83-9d89-fe3c75476c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.505964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d85db-2de9-4b83-9d89-fe3c75476c56 admin admin] PATH_INFO: `/v3/projects/c0989c06e7a9437298a39fe5b494bf68/users/a238069e6db74579aabbb59ff0b8ef00/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.528476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d85db-2de9-4b83-9d89-fe3c75476c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0989c06e7a9437298a39fe5b494bf68, user_id=a238069e6db74579aabbb59ff0b8ef00, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.531212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d85db-2de9-4b83-9d89-fe3c75476c56 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.612677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.614425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.638282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1011/2036] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:36 2022] PUT /identity/v3/projects/c0989c06e7a9437298a39fe5b494bf68/users/a238069e6db74579aabbb59ff0b8ef00/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:36.643290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649581b3-80bf-4f48-90a0-0953b52ef450 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:36.650953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.653544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.653986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.689531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:36.739910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] MFA Rules not processed for user `a238069e6db74579aabbb59ff0b8ef00`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:36.742340 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.765465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:36.766383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:36.766383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:36.766673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] PATH_INFO: `/v3/projects/2b53bd0853434866b3d5a21072120cb4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:36.769293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b53bd0853434866b3d5a21072120cb4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:36.771212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:36.864479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1012/2037] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:36.881941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:36.885844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:36.922169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b53bd0853434866b3d5a21072120cb4', 'request_id': 'req-5940c524-9b4f-41d6-a3d3-a2f100b3db43'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.936734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b53bd0853434866b3d5a21072120cb4', 'request_id': 'req-5940c524-9b4f-41d6-a3d3-a2f100b3db43'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:36.941865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b53bd0853434866b3d5a21072120cb4', 'request_id': 'req-5940c524-9b4f-41d6-a3d3-a2f100b3db43'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:37.010877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538b100-2565-4ebd-ae5c-6b97bff00e12 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.065423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] The token cache is being invalidate because project 2b53bd0853434866b3d5a21072120cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:37.070438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:37.070438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5940c524-9b4f-41d6-a3d3-a2f100b3db43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:37.070438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1026/2038] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:36 2022] DELETE /identity/v3/projects/2b53bd0853434866b3d5a21072120cb4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:37.073685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.073888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.074177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.087595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.088605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.089450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.090037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.093772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:37.121628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:37.123823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:37.177072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.179407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46c6eb-b3db-49d4-872b-783fc80f3586 service glance] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.215667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1013/2039] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:37.235196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1027/2040] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:37.246173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.246464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.246746 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.301085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:37.302344 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:37.304971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:37.330328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1014/2041] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:37.331406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.344230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c463a-8c31-4daf-9555-a0050469932d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.361130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.362002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.362440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.363030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.364518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:37.364990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.376918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.404413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1028/2042] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:37.408602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.419793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc029b5-a33c-46b2-afbd-ec285615f701 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.426502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.427725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.428438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.432017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.432918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.447047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.577287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1015/2043] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:37.580944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.594367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735728f-7964-4179-aa2e-579d4f625834 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.708330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.709049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.710021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.710440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.711115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.713172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.826360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1029/2044] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:37 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:37.830743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.842667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99223ab-ef91-40a1-9a6b-119935c6d600 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.847753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.848420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.848699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.848966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.849611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.851579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.862461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1016/2045] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:37.866464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.877536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe28c-2159-4178-9ede-1d6120b3ed95 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.882971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49db65-7e65-43da-b689-28c726ebe19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.883834 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49db65-7e65-43da-b689-28c726ebe19f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.884242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49db65-7e65-43da-b689-28c726ebe19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.890726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49db65-7e65-43da-b689-28c726ebe19f admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.890726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49db65-7e65-43da-b689-28c726ebe19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.890726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49db65-7e65-43da-b689-28c726ebe19f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:37.900293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1030/2046] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:37.904309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:37.931494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3a5d-af95-46c5-ad27-395b8fbd7d4c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:37.945686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:37.946991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:37.947342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:37.947638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] PATH_INFO: `/v3/projects/3f304106058c44768f925ad2c459ef5c/users/0f54bbb41d924a10886c4329f334f713/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:37.963511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f304106058c44768f925ad2c459ef5c, user_id=0f54bbb41d924a10886c4329f334f713, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:37.966285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:38.061108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1017/2047] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:37 2022] PUT /identity/v3/projects/3f304106058c44768f925ad2c459ef5c/users/0f54bbb41d924a10886c4329f334f713/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:38.073220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:38.073432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:38.073705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:38.109752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] MFA Rules not processed for user `0f54bbb41d924a10886c4329f334f713`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:38.110978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:38.145372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:38.180507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1031/2048] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:38.191644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:38.193341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:38.290705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cd13e-afe0-46d4-ab7d-9b7c0b6eeeea admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:38.299349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e82613-60ee-4485-95d4-76871027bd5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:38.300187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e82613-60ee-4485-95d4-76871027bd5a service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:38.300540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e82613-60ee-4485-95d4-76871027bd5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:38.301008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e82613-60ee-4485-95d4-76871027bd5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:38.339323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e82613-60ee-4485-95d4-76871027bd5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:38.341088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e82613-60ee-4485-95d4-76871027bd5a service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:38.355828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1018/2049] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:38.398851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:38.481245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbdde-6c1b-4e92-8a9d-dceb3e19ffde None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:38.486217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:38.486854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:38.487130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:38.487400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] PATH_INFO: `/v3/users/0f54bbb41d924a10886c4329f334f713` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:38.488703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f54bbb41d924a10886c4329f334f713)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:38.490778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:38.691135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f54bbb41d924a10886c4329f334f713'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:38.691927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f54bbb41d924a10886c4329f334f713'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:38.699425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f54bbb41d924a10886c4329f334f713'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:38.716592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f54bbb41d924a10886c4329f334f713'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:38.717961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f54bbb41d924a10886c4329f334f713'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:38.787807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1032/2050] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:38 2022] DELETE /identity/v3/users/0f54bbb41d924a10886c4329f334f713 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:38.792586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:38.793031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:38.793235 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:38.830713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:38.832308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:38.916013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1019/2051] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:38.932682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:38.934203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:38.959708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:38.976490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:39.021325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ce627-42b4-49f7-b64a-4d6a8eca7b54 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:39.026028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e48ad-75b4-4fca-b370-e68da09daaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:39.026028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e48ad-75b4-4fca-b370-e68da09daaac service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.026028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e48ad-75b4-4fca-b370-e68da09daaac service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.026265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e48ad-75b4-4fca-b370-e68da09daaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.061386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e48ad-75b4-4fca-b370-e68da09daaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:39.069712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e48ad-75b4-4fca-b370-e68da09daaac service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:39.097256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1033/2052] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:39.261299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:39.263041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:39.275603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5043a29-b016-4a5a-8902-1abafa251d17 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:39.280745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:39.281446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.281738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.282197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] PATH_INFO: `/v3/users/6d83b095cee345e09b8794a6ce527464` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.283203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d83b095cee345e09b8794a6ce527464)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:39.285253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:39.536069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d83b095cee345e09b8794a6ce527464'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:39.538943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d83b095cee345e09b8794a6ce527464'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:39.539262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d83b095cee345e09b8794a6ce527464'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:39.559132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d83b095cee345e09b8794a6ce527464'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:39.578355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d83b095cee345e09b8794a6ce527464'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:39.685810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1020/2053] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:39 2022] DELETE /identity/v3/users/6d83b095cee345e09b8794a6ce527464 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:39.690511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.690798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.691073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.711880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:39.713122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:39.773488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:39.775458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:39.786963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1034/2054] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:39.801325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276da89-de7a-4476-a1b2-a0d597357596 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:39.803189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:39.805394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:39.815386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:39.816059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.816393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.816674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] PATH_INFO: `/v3/projects/3f304106058c44768f925ad2c459ef5c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.819471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f304106058c44768f925ad2c459ef5c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:39.823156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:39.842127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:39.900041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e98ef9-d9f0-4145-ae80-8e271e36c39f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:39.904730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46703b-fa72-4e59-acf5-29d1f7965573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:39.905440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46703b-fa72-4e59-acf5-29d1f7965573 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.905779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46703b-fa72-4e59-acf5-29d1f7965573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.906191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46703b-fa72-4e59-acf5-29d1f7965573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.918916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46703b-fa72-4e59-acf5-29d1f7965573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:39.920822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46703b-fa72-4e59-acf5-29d1f7965573 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:39.933271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1035/2055] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:39.934502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5d88-9acc-489d-a7f2-2798e4490252 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.934781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5d88-9acc-489d-a7f2-2798e4490252 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.935049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b5d88-9acc-489d-a7f2-2798e4490252 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.936578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1036/2056] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:20:39.959956 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27773773-2c72-4b7b-9e8c-6a5791d5e919 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:39.960274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27773773-2c72-4b7b-9e8c-6a5791d5e919 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:39.961072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27773773-2c72-4b7b-9e8c-6a5791d5e919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:39.979513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:39.988273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f304106058c44768f925ad2c459ef5c', 'request_id': 'req-54f0f88b-3cbb-4883-bd7c-68d58d348e79'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.009720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f304106058c44768f925ad2c459ef5c', 'request_id': 'req-54f0f88b-3cbb-4883-bd7c-68d58d348e79'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.014783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f304106058c44768f925ad2c459ef5c', 'request_id': 'req-54f0f88b-3cbb-4883-bd7c-68d58d348e79'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.017221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-27773773-2c72-4b7b-9e8c-6a5791d5e919 None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:40.019307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-27773773-2c72-4b7b-9e8c-6a5791d5e919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.091020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] The token cache is being invalidate because project 3f304106058c44768f925ad2c459ef5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:40.091307 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.092212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.094160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1021/2057] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:39 2022] DELETE /identity/v3/projects/3f304106058c44768f925ad2c459ef5c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:40.095431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.101143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.134169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1037/2058] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:20:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:40.134552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3149-8df8-4f55-b94f-33c6d56e3517 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.134837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3149-8df8-4f55-b94f-33c6d56e3517 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.135106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3149-8df8-4f55-b94f-33c6d56e3517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.161763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-602b3149-8df8-4f55-b94f-33c6d56e3517 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:40.164121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-602b3149-8df8-4f55-b94f-33c6d56e3517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.207221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f88b-3cbb-4883-bd7c-68d58d348e79 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.207221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.207221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.207221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.207777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] PATH_INFO: `/v3/users/70f457820bed433881d1bcd0b6ec1540` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.208320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f457820bed433881d1bcd0b6ec1540)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.210424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.256355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1038/2059] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:40.256355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf764891-d8ab-4378-82c4-ef59771d56f4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.256355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf764891-d8ab-4378-82c4-ef59771d56f4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.256355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf764891-d8ab-4378-82c4-ef59771d56f4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.256355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1039/2060] 10.222.0.57 () {54 vars in 961 bytes} [Wed Sep 7 13:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:20:40.258451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104b75-587b-46c3-ad7f-281d5baf4e5d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.258566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104b75-587b-46c3-ad7f-281d5baf4e5d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.259526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57104b75-587b-46c3-ad7f-281d5baf4e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.280827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-57104b75-587b-46c3-ad7f-281d5baf4e5d None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:40.282027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-57104b75-587b-46c3-ad7f-281d5baf4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.292636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1040/2061] 10.222.0.57 () {58 vars in 1058 bytes} [Wed Sep 7 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:40.293849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.295140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.295140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.314732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:40.315924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.325647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1041/2062] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:40.326271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.340853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4571422-3c61-4698-89c1-15db6b25dc4a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.345918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.346517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.346820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.347091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.356116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.357688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.367167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1042/2063] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:40.368026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.378561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250046e9-001e-43fe-a7f7-5423cfdd1c08 service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.383800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.385632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.385632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.385632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.386024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:40.386415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.388341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.398294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f457820bed433881d1bcd0b6ec1540'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.402245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f457820bed433881d1bcd0b6ec1540'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.402661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1043/2064] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:40.403647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f457820bed433881d1bcd0b6ec1540'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.406881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.409373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.414028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f457820bed433881d1bcd0b6ec1540'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.428750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98bec2-4f0e-4399-ace4-1a1d96078a4b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.428950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f457820bed433881d1bcd0b6ec1540'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.434542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.435280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.435557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.435845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.436505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.438575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.451236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:40.492504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1022/2065] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:40 2022] DELETE /identity/v3/users/70f457820bed433881d1bcd0b6ec1540 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:40.492504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.492504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.543712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1044/2066] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:40 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:40.545550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.551179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:40.571133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7568-7bb1-43e4-80e0-85745594a5eb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.630344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75156f47-39d5-4557-a514-a42ab0d81801 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.637132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.637951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.638071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.638280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.638987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.640851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.656247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.656907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.657184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.657453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] PATH_INFO: `/v3/projects/173fb469b5a7422f8654240e976bf49b` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.658589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=173fb469b5a7422f8654240e976bf49b)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.660614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.754156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1045/2067] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:40 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:40.755297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.757728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.774672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91a41-1f1f-4e0f-8e3c-d52f0a27fe85 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.779545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173fb469b5a7422f8654240e976bf49b', 'request_id': 'req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.789816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173fb469b5a7422f8654240e976bf49b', 'request_id': 'req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.796553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173fb469b5a7422f8654240e976bf49b', 'request_id': 'req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.833589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.834338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.834587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.834850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] PATH_INFO: `/v3/projects/ca2bf3d4373c4714aa4ea10fad238a26` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.836048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2bf3d4373c4714aa4ea10fad238a26)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.837963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.875692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] The token cache is being invalidate because project 173fb469b5a7422f8654240e976bf49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:40.876293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.876716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.878317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1023/2068] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:40 2022] DELETE /identity/v3/projects/173fb469b5a7422f8654240e976bf49b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:40.879094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.880413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.892502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40122ba-0e4d-4d13-8da9-0d1ecdcf6a6f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.897007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.902601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.902601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.902601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.902601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.902601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.912158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1024/2069] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:40.913770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:40.915436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:40.927628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10ab66-c487-4871-b65a-eda2aa5a0833 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:40.932811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:40.935053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:40.935053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:40.935053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] PATH_INFO: `/v3/users/3b5ee3780e1c4b3cb77c21dad4824178` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:40.935053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5ee3780e1c4b3cb77c21dad4824178)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:40.936974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:40.973651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2bf3d4373c4714aa4ea10fad238a26', 'request_id': 'req-beb49754-7bfd-43ba-afd1-24295531f26e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.980364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2bf3d4373c4714aa4ea10fad238a26', 'request_id': 'req-beb49754-7bfd-43ba-afd1-24295531f26e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:40.986777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2bf3d4373c4714aa4ea10fad238a26', 'request_id': 'req-beb49754-7bfd-43ba-afd1-24295531f26e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.069521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] The token cache is being invalidate because project ca2bf3d4373c4714aa4ea10fad238a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:41.069812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.070446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.071970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1046/2070] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:40 2022] DELETE /identity/v3/projects/ca2bf3d4373c4714aa4ea10fad238a26 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:41.072923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.074211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.087998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:41.144307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb49754-7bfd-43ba-afd1-24295531f26e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.149897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c77050-addc-4b3a-a7a7-ef8622deb4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.150697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77050-addc-4b3a-a7a7-ef8622deb4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.151052 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77050-addc-4b3a-a7a7-ef8622deb4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.151390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c77050-addc-4b3a-a7a7-ef8622deb4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.152680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c77050-addc-4b3a-a7a7-ef8622deb4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.153764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c77050-addc-4b3a-a7a7-ef8622deb4c8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.159163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5ee3780e1c4b3cb77c21dad4824178'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.160270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5ee3780e1c4b3cb77c21dad4824178'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.163257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5ee3780e1c4b3cb77c21dad4824178'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.165575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1047/2071] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:41.166869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.167155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.167427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.174485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5ee3780e1c4b3cb77c21dad4824178'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.187233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:41.192485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5e5e49d9-7de8-4ea9-9b99-e3e10b7e335a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5ee3780e1c4b3cb77c21dad4824178'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.202955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:41.204205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.213205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1048/2072] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:41.214333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.215739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.232063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c1d9c-5c31-47b3-a300-bf516087af93 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.237030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbddb98-19e2-4945-95f0-ec230e7082f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.237697 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddb98-19e2-4945-95f0-ec230e7082f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.237969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddb98-19e2-4945-95f0-ec230e7082f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.238235 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbddb98-19e2-4945-95f0-ec230e7082f2 admin admin] PATH_INFO: `/v3/projects/cbd98322e1b7485e8d74afdce0998fde/users/349c6d05068e405685cbace0081e4453/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.253578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1025/2073] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:40 2022] DELETE /identity/v3/users/3b5ee3780e1c4b3cb77c21dad4824178 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:41.255708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.255991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.262475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.265066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbddb98-19e2-4945-95f0-ec230e7082f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd98322e1b7485e8d74afdce0998fde, user_id=349c6d05068e405685cbace0081e4453, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.267359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbddb98-19e2-4945-95f0-ec230e7082f2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.282392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:41.283596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.333389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1049/2074] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:41 2022] PUT /identity/v3/projects/cbd98322e1b7485e8d74afdce0998fde/users/349c6d05068e405685cbace0081e4453/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:41.348904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.349188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.349465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.371630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1026/2075] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:41.375805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.394863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] MFA Rules not processed for user `349c6d05068e405685cbace0081e4453`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:41.396010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.403823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff444-a116-4178-beb2-eee08d1739ee None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.462376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1050/2076] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:41.467295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.473258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.473258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.473258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.473258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:41.473258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.473258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.474761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.476227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.484284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1027/2077] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:41.488699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.502113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd83144-a078-4436-acaa-bc9af1749aa7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.512595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.513227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.513552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.513832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.514475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.516416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.558006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ba44-f6e7-4174-b3b6-b54372d9979d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.566246 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.566989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.568460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.569431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.596410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.596410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.608997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1051/2078] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:41.665051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1028/2079] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:41 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:41.672789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.685713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b03800-0713-4ae9-84fe-59913cbd62f0 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.690023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:41.754562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.755193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.755459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.755725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.758542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.760549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.769572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.774941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:41.793427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d12950-70a7-4c6c-8184-272d7f762323 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.805147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.805960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.806230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.806491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] PATH_INFO: `/v3/projects/db441a8baf324ec1a50e109a83983903` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.807636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db441a8baf324ec1a50e109a83983903)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.814416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.865930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1052/2080] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:41 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:41.870077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.881363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91376553-5de7-441f-bcac-60da091ba7bc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.902215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db441a8baf324ec1a50e109a83983903', 'request_id': 'req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.904369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:41.909964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db441a8baf324ec1a50e109a83983903', 'request_id': 'req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.917887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db441a8baf324ec1a50e109a83983903', 'request_id': 'req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.949913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.950526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.950801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.951092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.951783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.953544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.964188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1053/2081] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:41.967990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.979253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42b025-7e2c-40a4-aa07-ac74e3aaf07d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:41.984593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] The token cache is being invalidate because project db441a8baf324ec1a50e109a83983903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:41.984593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.984593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:41.984593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1029/2082] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:41 2022] DELETE /identity/v3/projects/db441a8baf324ec1a50e109a83983903 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:41.984907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:41.984907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:41.985231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:41.985509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:41.986157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:41.987751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:41.988005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:41.989387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:42.009430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1054/2083] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:42.009633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa1b3c-3ad4-4ed1-80ba-22a3d3d5b51a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.009725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:42.009808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.009808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.009808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.009808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] PATH_INFO: `/v3/users/fc3e5c4d57f64277b562f7bc0dc4d4ef` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.010373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3e5c4d57f64277b562f7bc0dc4d4ef)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.011700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:42.012358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:42.026138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eab86-e0c7-4c8b-8266-5aa1e1a6e37a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.031100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36a1ae-80a4-4798-997a-0fd18ff36a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.031767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a1ae-80a4-4798-997a-0fd18ff36a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.032021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a1ae-80a4-4798-997a-0fd18ff36a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.032489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36a1ae-80a4-4798-997a-0fd18ff36a53 admin admin] PATH_INFO: `/v3/projects/97449c49f5574c9184473ba1053320a5/users/bd8e27306c324cf29a91ee0fcdaa9dbe/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.049427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36a1ae-80a4-4798-997a-0fd18ff36a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97449c49f5574c9184473ba1053320a5, user_id=bd8e27306c324cf29a91ee0fcdaa9dbe, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.052136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36a1ae-80a4-4798-997a-0fd18ff36a53 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:42.117408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1055/2084] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:42 2022] PUT /identity/v3/projects/97449c49f5574c9184473ba1053320a5/users/bd8e27306c324cf29a91ee0fcdaa9dbe/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:42.128050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.128419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.128692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.157396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] MFA Rules not processed for user `bd8e27306c324cf29a91ee0fcdaa9dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:42.158957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:42.197614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3e5c4d57f64277b562f7bc0dc4d4ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:42.198084 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3e5c4d57f64277b562f7bc0dc4d4ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:42.199431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3e5c4d57f64277b562f7bc0dc4d4ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:42.208802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3e5c4d57f64277b562f7bc0dc4d4ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:42.220495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:42.225323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3e5c4d57f64277b562f7bc0dc4d4ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:42.245236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1056/2085] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:42.249479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:42.250773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:42.310799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1030/2086] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:41 2022] DELETE /identity/v3/users/fc3e5c4d57f64277b562f7bc0dc4d4ef => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:42.343527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7088629-e097-4c32-9d42-576f7378d049 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.470488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.470488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.470488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.470488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.470848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.473587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:42.579636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1057/2087] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:42 2022] POST /identity/v3/projects => generated 365 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:42.583644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:42.597409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f811eff-7989-46b5-a378-388b0db057d0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.690055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.690859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.691150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.691422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.692107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.694155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:42.854400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1031/2088] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:42 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:42.854913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:42.856807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:42.857859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:42.869993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98366c6-a562-465f-be40-b5b1bf9b3762 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.871382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a2f8b-8140-4382-bb30-a7de5730741b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.876741 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.877136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.877783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.877925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.878095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.878208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.878503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] PATH_INFO: `/v3/projects/b92895a4f352405e83227a62383e3b77` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.878610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.878999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.879601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92895a4f352405e83227a62383e3b77)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.882092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:42.882324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:42.901822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1032/2089] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:42.903194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:42.915718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac151461-194d-48f2-b227-4b72c8f42239 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:42.920502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:42.921134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:42.921404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:42.921669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] PATH_INFO: `/v3/projects/32124c839cbf4e7b919845435a76dae6/users/a365dcfbdef544a2b4144ff546f193f2/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:42.936688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32124c839cbf4e7b919845435a76dae6, user_id=a365dcfbdef544a2b4144ff546f193f2, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:42.939442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.003897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1033/2090] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:42 2022] PUT /identity/v3/projects/32124c839cbf4e7b919845435a76dae6/users/a365dcfbdef544a2b4144ff546f193f2/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:43.008397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.014377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92895a4f352405e83227a62383e3b77', 'request_id': 'req-292c0e34-561e-478b-9593-c68e2dca94d9'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.019029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=81,keystone:DELETE=13,keystone:INSERT=6 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:43.023465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92895a4f352405e83227a62383e3b77', 'request_id': 'req-292c0e34-561e-478b-9593-c68e2dca94d9'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.030306 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92895a4f352405e83227a62383e3b77', 'request_id': 'req-292c0e34-561e-478b-9593-c68e2dca94d9'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.076736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf8ebf-532d-410d-8558-09e00976fc82 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.087957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] The token cache is being invalidate because project b92895a4f352405e83227a62383e3b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:43.088261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.088895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-292c0e34-561e-478b-9593-c68e2dca94d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:43.090400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1058/2091] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:42 2022] DELETE /identity/v3/projects/b92895a4f352405e83227a62383e3b77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:43.096404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2d77-0c44-4879-acff-b41e0cd7a7ba None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.096684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2d77-0c44-4879-acff-b41e0cd7a7ba None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.097080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2d77-0c44-4879-acff-b41e0cd7a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.105075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:43.120651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-544f2d77-0c44-4879-acff-b41e0cd7a7ba None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:43.125191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-544f2d77-0c44-4879-acff-b41e0cd7a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:43.134345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.134948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.135220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.135484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.136178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.137800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.148623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1034/2092] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:43.152708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.154585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:43.167593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7f65d-05b7-4869-9d8e-facb76fb43e7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.173470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f33d17-3e37-4a68-957a-37d33ca01b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.174360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f33d17-3e37-4a68-957a-37d33ca01b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.174721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f33d17-3e37-4a68-957a-37d33ca01b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.175153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f33d17-3e37-4a68-957a-37d33ca01b10 admin admin] PATH_INFO: `/v3/projects/32124c839cbf4e7b919845435a76dae6/users/a365dcfbdef544a2b4144ff546f193f2/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.177781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f33d17-3e37-4a68-957a-37d33ca01b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32124c839cbf4e7b919845435a76dae6, user_id=a365dcfbdef544a2b4144ff546f193f2, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.182533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f33d17-3e37-4a68-957a-37d33ca01b10 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.188788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1059/2093] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:43.191944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1035/2094] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:43 2022] PUT /identity/v3/projects/32124c839cbf4e7b919845435a76dae6/users/a365dcfbdef544a2b4144ff546f193f2/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:43.199233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.199514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.199821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.204075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.208283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.208283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.220903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:43.222108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:43.234503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] MFA Rules not processed for user `a365dcfbdef544a2b4144ff546f193f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:43.235724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:43.293009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1060/2095] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:43.297429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.307036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba556b7-8f2e-47ad-9d32-95047594dfc6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.311546 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1036/2096] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:43.315777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.315777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.315777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.315777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.316172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:43.316172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.316172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.324425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.325808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:43.332777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1061/2097] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:43.336309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.346166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572173f7-3a18-4775-a1bc-631d7d2cd234 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.351023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.351569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.351846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.352144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.352801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.354746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.385343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27ebe9-20dc-4478-8e5e-c0acfcd70ad2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.389461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.390067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.390415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.390660 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.400181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.401646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.412468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1037/2098] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:43.471487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1062/2099] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:43.476286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.487692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525638d-8de6-4765-8d0b-4c8e3cd9016d service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.550057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.550845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.551105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.551370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.552009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.554646 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.671502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1038/2100] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:43.675757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.688100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cd6b8-307b-425f-b5b0-1aebba1a6fdc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.696154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.696791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.698524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.698524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.698524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.700145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.711287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1063/2101] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:43.716888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.728915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fd7a5-6077-4b9a-bb50-74ade8090c49 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.741792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b052-4102-4efc-9c71-b4bf9d81ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.742569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b052-4102-4efc-9c71-b4bf9d81ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.742988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b052-4102-4efc-9c71-b4bf9d81ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.743345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b052-4102-4efc-9c71-b4bf9d81ba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.744060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b052-4102-4efc-9c71-b4bf9d81ba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.745810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b052-4102-4efc-9c71-b4bf9d81ba7c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.760910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1039/2102] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:43.764989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:43.780000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d265b85-4e98-4047-a1bf-1b2c01acd0cd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:43.785254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:43.785935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.786212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.786514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] PATH_INFO: `/v3/projects/40d6de586aea492485f2a761fb63c216/users/b6ef7a3fcab14151aa4d75c5ef69a7a5/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.803634 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d6de586aea492485f2a761fb63c216, user_id=b6ef7a3fcab14151aa4d75c5ef69a7a5, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:43.806332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:43.889970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1064/2103] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:43 2022] PUT /identity/v3/projects/40d6de586aea492485f2a761fb63c216/users/b6ef7a3fcab14151aa4d75c5ef69a7a5/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:43.900881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:43.901164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:43.901434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:43.933114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] MFA Rules not processed for user `b6ef7a3fcab14151aa4d75c5ef69a7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:43.935173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.016569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1040/2104] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:44.021229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.036289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.082718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.103391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dac3d8-e6ad-429a-98f9-e79f10c0b8d4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.109258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.109258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.109258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.109555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.110021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.111919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.199788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1065/2105] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:44 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:44.203772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.215227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb2570-62a5-4d48-84b1-1f71cbff8607 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.277031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.277690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.277961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.278246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.278870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.282636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.299536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.373534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.381663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1041/2106] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:44 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:44.389327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.389832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270c830-26be-44ea-b061-a8c1c1cc05f3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.394695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.399189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.399189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.399189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] PATH_INFO: `/v3/users/bd8e27306c324cf29a91ee0fcdaa9dbe` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.399189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8e27306c324cf29a91ee0fcdaa9dbe)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.400573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.401924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91458e-e65a-4949-b89c-afd5c0e606b2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.423150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.427354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.427354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.427354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.427354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.427354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.438887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1042/2107] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:44.442879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.453052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518be45-197d-406a-90f3-4b6b7529aaa1 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.458070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.458762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.459035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.459940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] PATH_INFO: `/v3/projects/8fd2ab38444644c2bada2dc0e9041b65/users/e342c5a7796744a187dc5007a08a024b/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.475773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2ab38444644c2bada2dc0e9041b65, user_id=e342c5a7796744a187dc5007a08a024b, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.479813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.591635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1043/2108] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:44 2022] PUT /identity/v3/projects/8fd2ab38444644c2bada2dc0e9041b65/users/e342c5a7796744a187dc5007a08a024b/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:44.595549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.641282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8e27306c324cf29a91ee0fcdaa9dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.645227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8e27306c324cf29a91ee0fcdaa9dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.674311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8e27306c324cf29a91ee0fcdaa9dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.689571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3672a66-524f-42d9-83e1-e13a2b7a7850 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.694892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8e27306c324cf29a91ee0fcdaa9dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.696056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fa6ef263-e373-463b-9d93-b9b683c3eee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8e27306c324cf29a91ee0fcdaa9dbe'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:44.698452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.699184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.699574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.699906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.700740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.703574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.715694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1044/2109] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:44.719853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.721700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.736833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfee30e-8785-4d49-95b5-0f0029b66694 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:44.743098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444961a-d3ce-4d3f-9c69-45047d950598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:44.743893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444961a-d3ce-4d3f-9c69-45047d950598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.744303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444961a-d3ce-4d3f-9c69-45047d950598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.744668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444961a-d3ce-4d3f-9c69-45047d950598 admin admin] PATH_INFO: `/v3/projects/8fd2ab38444644c2bada2dc0e9041b65/users/e342c5a7796744a187dc5007a08a024b/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.746662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444961a-d3ce-4d3f-9c69-45047d950598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2ab38444644c2bada2dc0e9041b65, user_id=e342c5a7796744a187dc5007a08a024b, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:44.749417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444961a-d3ce-4d3f-9c69-45047d950598 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:44.764873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1045/2110] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:44 2022] PUT /identity/v3/projects/8fd2ab38444644c2bada2dc0e9041b65/users/e342c5a7796744a187dc5007a08a024b/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:44.775955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.776341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.776715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.793605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1066/2111] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:44 2022] DELETE /identity/v3/users/bd8e27306c324cf29a91ee0fcdaa9dbe => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:44.800768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:44.801148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:44.801489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:44.827600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:44.829742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.837809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] MFA Rules not processed for user `e342c5a7796744a187dc5007a08a024b`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:44.839386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.916282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1067/2112] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:44.923300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.924909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.929549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:44.939492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1046/2113] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:44.951852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:44.953643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:44.975413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:45.000946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a338927-b2dc-40ef-a9c4-cdad88b0db32 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.005353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.006039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.006831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.007097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.019683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.021290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.036253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1068/2114] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:45.056435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ef349-08f4-4b7b-b2c1-9edc942a03b8 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.060502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.061296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.068170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.068170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.072740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.074243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.083878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1047/2115] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:45.524799 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.526229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:45.552137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff8266-7d51-4d0c-8c87-2a88dfc10be8 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.560926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.560926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.560926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.560926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] PATH_INFO: `/v3/projects/97449c49f5574c9184473ba1053320a5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.561616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97449c49f5574c9184473ba1053320a5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.562206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.766607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97449c49f5574c9184473ba1053320a5', 'request_id': 'req-66d17039-ee48-46c7-b3ee-55e26d0d2f25'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.773274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97449c49f5574c9184473ba1053320a5', 'request_id': 'req-66d17039-ee48-46c7-b3ee-55e26d0d2f25'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.778632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97449c49f5574c9184473ba1053320a5', 'request_id': 'req-66d17039-ee48-46c7-b3ee-55e26d0d2f25'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.826771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.838178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9bfff-b7d8-489b-9775-dc7ef61b862e service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.875727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] The token cache is being invalidate because project 97449c49f5574c9184473ba1053320a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:45.879970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.879970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:45.879970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1069/2116] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:45 2022] DELETE /identity/v3/projects/97449c49f5574c9184473ba1053320a5 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:45.882604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:45.884300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:45.919064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.919645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.919922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.921584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] PATH_INFO: `/v3/users/b6ef7a3fcab14151aa4d75c5ef69a7a5` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.922469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ef7a3fcab14151aa4d75c5ef69a7a5)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.924856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:45.968585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d17039-ee48-46c7-b3ee-55e26d0d2f25 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:45.973649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:45.974294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:45.974572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:45.974875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] PATH_INFO: `/v3/users/a365dcfbdef544a2b4144ff546f193f2` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:45.976020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a365dcfbdef544a2b4144ff546f193f2)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:45.978153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:46.081871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ef7a3fcab14151aa4d75c5ef69a7a5'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.082518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ef7a3fcab14151aa4d75c5ef69a7a5'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.083114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ef7a3fcab14151aa4d75c5ef69a7a5'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.091561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ef7a3fcab14151aa4d75c5ef69a7a5'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.106012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-afca1699-6779-4f72-92f4-3947da5d67ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ef7a3fcab14151aa4d75c5ef69a7a5'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.170295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a365dcfbdef544a2b4144ff546f193f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.170962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a365dcfbdef544a2b4144ff546f193f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.178823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a365dcfbdef544a2b4144ff546f193f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.179959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1048/2117] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:45 2022] DELETE /identity/v3/users/b6ef7a3fcab14151aa4d75c5ef69a7a5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:46.181666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:46.184475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:46.184857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:46.186576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:46.194534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a365dcfbdef544a2b4144ff546f193f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.194534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a365dcfbdef544a2b4144ff546f193f2'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.205562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:46.206813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:46.219601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:46.264514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1070/2118] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:45 2022] DELETE /identity/v3/users/a365dcfbdef544a2b4144ff546f193f2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:46.275564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1049/2119] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:46.285972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:46.290534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:46.356921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614def-398f-4063-8408-d8bb9ffd1346 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:46.361511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d3cb-9a0b-4975-8033-1606e5289b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:46.362281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d3cb-9a0b-4975-8033-1606e5289b9d service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:46.362559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d3cb-9a0b-4975-8033-1606e5289b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:46.362828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d3cb-9a0b-4975-8033-1606e5289b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:46.425973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d3cb-9a0b-4975-8033-1606e5289b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:46.427321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548d3cb-9a0b-4975-8033-1606e5289b9d service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:46.438575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1071/2120] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:46.723655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:46.729460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:46.740060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3676-248b-4e5a-9876-b59e109dde30 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:46.747215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:46.748704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:46.748704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:46.748704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] PATH_INFO: `/v3/projects/32124c839cbf4e7b919845435a76dae6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:46.751583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32124c839cbf4e7b919845435a76dae6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:46.751793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:46.904939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32124c839cbf4e7b919845435a76dae6', 'request_id': 'req-aa536b02-6174-4eac-9b94-92668630a347'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.912031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32124c839cbf4e7b919845435a76dae6', 'request_id': 'req-aa536b02-6174-4eac-9b94-92668630a347'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.919398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32124c839cbf4e7b919845435a76dae6', 'request_id': 'req-aa536b02-6174-4eac-9b94-92668630a347'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.995950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] The token cache is being invalidate because project 32124c839cbf4e7b919845435a76dae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:46.996369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.996991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aa536b02-6174-4eac-9b94-92668630a347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:46.998491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1050/2121] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:46 2022] DELETE /identity/v3/projects/32124c839cbf4e7b919845435a76dae6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:47.003747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.004313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.004508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.025931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:47.027150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:47.092587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1072/2122] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:47.100627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.101081 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.101154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.121584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:47.122806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:47.129261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.133391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:47.143228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1051/2123] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:47.147903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.152432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf8dda-0379-4b7d-947d-5b05b8bf7839 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.157783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.158421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.158695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.158967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] PATH_INFO: `/v3/projects/40d6de586aea492485f2a761fb63c216` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.160198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d6de586aea492485f2a761fb63c216)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.161403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16473e7-0616-4700-88ff-732b1ce17d6a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.162387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.167525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.168254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.168597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.168934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.169656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:47.170025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.171743 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.190204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1052/2124] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:47.191452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.191760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:47.203130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831dba9-8f05-4303-a2e8-9d4cece7b8b8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.207889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.208530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.208801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.209113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.210176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.213027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.301764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d6de586aea492485f2a761fb63c216', 'request_id': 'req-cc48ed9e-4586-4065-a71b-66a7d63c73e6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.321603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d6de586aea492485f2a761fb63c216', 'request_id': 'req-cc48ed9e-4586-4065-a71b-66a7d63c73e6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.334579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d6de586aea492485f2a761fb63c216', 'request_id': 'req-cc48ed9e-4586-4065-a71b-66a7d63c73e6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.337664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1053/2125] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:47 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:47.341129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.407447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] The token cache is being invalidate because project 40d6de586aea492485f2a761fb63c216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:47.407447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.408210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.416651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1073/2126] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:47 2022] DELETE /identity/v3/projects/40d6de586aea492485f2a761fb63c216 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:47.417950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.420310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:47.457794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5174f-f8c1-463c-8ae1-22c3d307578e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.469411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.470039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.470369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.470640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.471276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.483647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.489470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:47.528071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48ed9e-4586-4065-a71b-66a7d63c73e6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.532938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.533574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.533849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.534121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] PATH_INFO: `/v3/users/e342c5a7796744a187dc5007a08a024b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.535288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e342c5a7796744a187dc5007a08a024b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.537941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.644131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1054/2127] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:47 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:47.647791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.650424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:47.664068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7eba9b-7251-4c62-b392-783c0e5fdbe4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.669134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.669958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.670152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.670421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.671141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.672791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.684765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1055/2128] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:47.688731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.698552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b09120e-a585-43ff-a0ed-e6ad3f02ea2c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.703337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.704263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.704263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.704512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.705137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.706774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.718641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1056/2129] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:47.723904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.738310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fc364-ea08-446e-bdf0-99ab61ff77eb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:47.739401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e342c5a7796744a187dc5007a08a024b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.740796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e342c5a7796744a187dc5007a08a024b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.745228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:47.745931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.746210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.746479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] PATH_INFO: `/v3/projects/604724c83e7a4ab18aed1cf85c185c1c/users/0eaa8c36652247f7ad9774a7c4887f7d/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.748638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e342c5a7796744a187dc5007a08a024b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.763807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] RBAC: Authorizing `identity:create_grant(project_id=604724c83e7a4ab18aed1cf85c185c1c, user_id=0eaa8c36652247f7ad9774a7c4887f7d, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:47.764217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e342c5a7796744a187dc5007a08a024b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.764217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-694aef4b-d95a-4b5b-bb16-d79a049adb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e342c5a7796744a187dc5007a08a024b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:47.764403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:47.854084 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1074/2130] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:47 2022] DELETE /identity/v3/users/e342c5a7796744a187dc5007a08a024b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:47.854289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1057/2131] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:47 2022] PUT /identity/v3/projects/604724c83e7a4ab18aed1cf85c185c1c/users/0eaa8c36652247f7ad9774a7c4887f7d/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:47.865656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:47.865656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:47.865656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:47.900160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] MFA Rules not processed for user `0eaa8c36652247f7ad9774a7c4887f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:47.901544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:47.920305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:47.971196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1075/2132] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:47.976615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:47.978463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:48.058204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c041f-3591-461a-b9bb-6e251762225b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.149907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.149907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.149907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.149907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.150707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.153055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.271465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1058/2133] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:47 2022] POST /identity/v3/projects => generated 367 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:48.276560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.287294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b573724-5123-4c91-8708-1b037e83f6af None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.343243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.345123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:48.364786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.364786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.364786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.365220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.365961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.367771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.408548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:48.432784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2aac8-c605-46d9-a1c7-ee2bb04dba00 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.437856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.438582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.438862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.439135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] PATH_INFO: `/v3/projects/8fd2ab38444644c2bada2dc0e9041b65` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.443900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd2ab38444644c2bada2dc0e9041b65)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.445906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.451569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1076/2134] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:48 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:48.452529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.462715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba047-d4c4-453a-90f5-fb8f00b3dc19 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.467376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.467962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.468279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.468579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.469219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.470800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.480818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1077/2135] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:48.484900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.495105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96d4e8-7dfb-4c16-9f69-b07bf60b3bd4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.500926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.501585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.501850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.502115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] PATH_INFO: `/v3/projects/6305b422e81d4202a96bc15b81385048/users/3867638aceb14cbf8179c85628f3dc8e/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.523190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305b422e81d4202a96bc15b81385048, user_id=3867638aceb14cbf8179c85628f3dc8e, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.525491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.620047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1078/2136] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:48 2022] PUT /identity/v3/projects/6305b422e81d4202a96bc15b81385048/users/3867638aceb14cbf8179c85628f3dc8e/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:48.625508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.627341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd2ab38444644c2bada2dc0e9041b65', 'request_id': 'req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:48.634555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd2ab38444644c2bada2dc0e9041b65', 'request_id': 'req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:48.640392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd2ab38444644c2bada2dc0e9041b65', 'request_id': 'req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:48.708695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461317ef-bd26-4f70-b91d-71464ac6d17e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.724577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:48.744362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] The token cache is being invalidate because project 8fd2ab38444644c2bada2dc0e9041b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:48.744772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:48.745458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0ac5f769-a324-40b7-9ba6-78a11d4a32bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:48.746979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1059/2137] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:48 2022] DELETE /identity/v3/projects/8fd2ab38444644c2bada2dc0e9041b65 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:48.751818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f84d3c-bbbd-46ef-a4d4-e9d019b69b24 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.752128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f84d3c-bbbd-46ef-a4d4-e9d019b69b24 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.752404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f84d3c-bbbd-46ef-a4d4-e9d019b69b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.766074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.771002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.771002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.771002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.771002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.771002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.773553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-55f84d3c-bbbd-46ef-a4d4-e9d019b69b24 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:48.774736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-55f84d3c-bbbd-46ef-a4d4-e9d019b69b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:48.780161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1079/2138] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:48.783787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1060/2139] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:48.788046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.791005 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:48.791485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.791768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.792038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.804422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4036a0-5f78-45fd-9ec3-e676c859d833 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.809322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b0838-921c-458f-9f2d-fdf7b991e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.809997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b0838-921c-458f-9f2d-fdf7b991e468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.810274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b0838-921c-458f-9f2d-fdf7b991e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.810542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b0838-921c-458f-9f2d-fdf7b991e468 admin admin] PATH_INFO: `/v3/projects/6305b422e81d4202a96bc15b81385048/users/3867638aceb14cbf8179c85628f3dc8e/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.812132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:48.812605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b0838-921c-458f-9f2d-fdf7b991e468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305b422e81d4202a96bc15b81385048, user_id=3867638aceb14cbf8179c85628f3dc8e, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.813322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:48.815308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b0838-921c-458f-9f2d-fdf7b991e468 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.821938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1061/2140] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:48.826353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.830777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1080/2141] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:48 2022] PUT /identity/v3/projects/6305b422e81d4202a96bc15b81385048/users/3867638aceb14cbf8179c85628f3dc8e/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:48.835519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd8f30e-fd50-47ca-bb47-3e8349bfbff3 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.842294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f54909-b794-4af6-a311-523bda525e89 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.842600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f54909-b794-4af6-a311-523bda525e89 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.842875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f54909-b794-4af6-a311-523bda525e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.871528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-94f54909-b794-4af6-a311-523bda525e89 None None] MFA Rules not processed for user `3867638aceb14cbf8179c85628f3dc8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:48.872755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-94f54909-b794-4af6-a311-523bda525e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:48.893579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.894195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.894499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.894766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.895435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:48.895732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.897392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.909152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1062/2142] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:48.914046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.923971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e45e4f8-4fee-4a60-88a8-c09c40f2cd04 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:48.929282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:48.929870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:48.930143 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:48.930410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:48.931029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:48.932954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:48.943463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1081/2143] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:48.956366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f54909-b794-4af6-a311-523bda525e89 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:48.957784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-94f54909-b794-4af6-a311-523bda525e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:49.013724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f54909-b794-4af6-a311-523bda525e89 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.017419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.018014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.021386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.021386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.027567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.028973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.039537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1082/2144] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:49.049721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1063/2145] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:48 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:49.054559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.071758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8fe48-2711-4179-8403-d8ceaf11ae43 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.115983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:49.135825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.136510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.136804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.137072 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.137695 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.139579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.168354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.170060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:49.197979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:49.229293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630329-957a-4090-98dd-913831d4a544 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.233127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.233552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1083/2146] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:49 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:49.237352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.237352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.237352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.238633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.240849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:49.250953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c37f-c2ab-4258-bbe1-94edbf8c3647 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.259137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.259909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.260298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.260632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.262560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.263128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.273985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1084/2147] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:49.278045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.289176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16acb42-a0dc-44bd-8c4b-64b4c46756c4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.293893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.294518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.294817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.295098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.295738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.302645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.304798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.306222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2115d-bac2-4dc4-8d92-73b744e57966 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.308584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1085/2148] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:49.312752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.317956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1064/2149] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:49.322726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec9db0-2eab-4085-b0f0-91e9747c48c7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.327572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.328261 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.328541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.328810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] PATH_INFO: `/v3/projects/66cb4612eaba489c903e294675682084/users/57e748ee8a9f4c3d9617900b7d9ddad1/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.346626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cb4612eaba489c903e294675682084, user_id=57e748ee8a9f4c3d9617900b7d9ddad1, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.349448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.452701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1086/2150] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:49 2022] PUT /identity/v3/projects/66cb4612eaba489c903e294675682084/users/57e748ee8a9f4c3d9617900b7d9ddad1/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:49.463648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.463924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.464237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.494610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] MFA Rules not processed for user `57e748ee8a9f4c3d9617900b7d9ddad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:49.495849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:49.562159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1065/2151] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:49.566846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.634053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1714e6-c322-4da7-a10d-e021b96151a5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.638738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.639398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.639622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.639888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.640538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.642457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.732202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1087/2152] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:49 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:49.736255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.751568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afd08d-6e9a-44a4-a442-4c83613aa6fe None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.818079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.819256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.819529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.819791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.820471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.822403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:49.945455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:49.952379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1066/2153] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:49 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:49.956701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:49.975538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e985873-b864-4dae-9e5f-d2f3024014a4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:49.981760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:49.986193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:49.986193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:49.986193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:49.986193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:49.986193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:50.007427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1088/2154] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:50.008805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:50.019717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40200d42-0034-4e49-a59d-5637af428d93 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:50.025217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:50.040237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:50.040543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:50.040791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] PATH_INFO: `/v3/projects/d91c1cb1191e46cb90e1154e6d220337/users/50caea19ea9d406aa27edc074387dbb3/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:50.060348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91c1cb1191e46cb90e1154e6d220337, user_id=50caea19ea9d406aa27edc074387dbb3, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:50.063114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:50.123771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1067/2155] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:50 2022] PUT /identity/v3/projects/d91c1cb1191e46cb90e1154e6d220337/users/50caea19ea9d406aa27edc074387dbb3/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:50.126918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:50.138857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff3924-1b68-43c2-976c-98a905769cba admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:50.196453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:50.208351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30479d-337c-4b0e-a0c3-a92b3024cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:50.208990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30479d-337c-4b0e-a0c3-a92b3024cdfc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:50.209288 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30479d-337c-4b0e-a0c3-a92b3024cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:50.209554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30479d-337c-4b0e-a0c3-a92b3024cdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:50.210272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30479d-337c-4b0e-a0c3-a92b3024cdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:50.211794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30479d-337c-4b0e-a0c3-a92b3024cdfc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:50.222696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1089/2156] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:50.227059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:50.238262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67249dec-a4d9-439d-8237-ed2d946c3a5c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:50.245430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:50.245430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:50.245430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:50.245430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] PATH_INFO: `/v3/projects/d91c1cb1191e46cb90e1154e6d220337/users/50caea19ea9d406aa27edc074387dbb3/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:50.247685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91c1cb1191e46cb90e1154e6d220337, user_id=50caea19ea9d406aa27edc074387dbb3, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:50.250705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:50.278168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1068/2157] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:50 2022] PUT /identity/v3/projects/d91c1cb1191e46cb90e1154e6d220337/users/50caea19ea9d406aa27edc074387dbb3/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:50.279272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f9508-4811-459c-9652-6716e0daade8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:50.279720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f9508-4811-459c-9652-6716e0daade8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:50.280003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f9508-4811-459c-9652-6716e0daade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:50.311585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-390f9508-4811-459c-9652-6716e0daade8 None None] MFA Rules not processed for user `50caea19ea9d406aa27edc074387dbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:50.312844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-390f9508-4811-459c-9652-6716e0daade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:50.397561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1090/2158] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:50.430721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:50.497419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c187fe-0da2-45af-9f82-8806d7b68f96 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:50.501157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:50.501770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:50.502041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:50.502341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:50.512262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:50.513763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:50.523443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1069/2159] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:50.800006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f9508-4811-459c-9652-6716e0daade8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:50.810178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f9508-4811-459c-9652-6716e0daade8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:50.814240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:50.814839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:50.815249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:50.815527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:50.882986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:50.883840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:50.893316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1091/2160] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:51.153595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:51.163188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e9025-b388-49e7-9927-c6e2b98e3994 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:51.168818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:51.169726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:51.171147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:51.171687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:51.174704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:51.261199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:51.262711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c5aba-f808-4d2d-b92c-33ef45ecbd04 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:51.273322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1070/2161] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:52.172330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:52.288150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fbe36-e234-4dde-b3d3-7388737cc905 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:52.302347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:52.303698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:52.304123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:52.304455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] PATH_INFO: `/v3/users/57e748ee8a9f4c3d9617900b7d9ddad1` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:52.308289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e748ee8a9f4c3d9617900b7d9ddad1)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:52.310881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:52.324125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:52.505191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e748ee8a9f4c3d9617900b7d9ddad1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:52.506441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e748ee8a9f4c3d9617900b7d9ddad1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:52.515698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e748ee8a9f4c3d9617900b7d9ddad1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:52.531391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e748ee8a9f4c3d9617900b7d9ddad1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:52.532179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e748ee8a9f4c3d9617900b7d9ddad1'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:52.588029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1092/2162] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:52 2022] DELETE /identity/v3/users/57e748ee8a9f4c3d9617900b7d9ddad1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:52.589709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:52.590223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:52.590330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:52.610859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:52.612734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:52.677189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:52.691369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1071/2163] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:52.707553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:52.709082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:52.796062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b09c3-5337-49af-a43b-47af062bc2b2 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:52.800369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:52.800979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:52.801257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:52.801527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:52.812117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:52.813559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:52.825532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1093/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:53.254931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:53.257382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:53.277187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d3e27-51ad-46f1-9047-76d1a3313efc None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:53.294018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:53.294682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:53.294956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:53.295240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] PATH_INFO: `/v3/projects/66cb4612eaba489c903e294675682084` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:53.297254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cb4612eaba489c903e294675682084)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:53.299263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:53.413500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cb4612eaba489c903e294675682084', 'request_id': 'req-66e03ec9-46d3-42e3-8ac4-fe0934602e37'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.420014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cb4612eaba489c903e294675682084', 'request_id': 'req-66e03ec9-46d3-42e3-8ac4-fe0934602e37'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.426183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cb4612eaba489c903e294675682084', 'request_id': 'req-66e03ec9-46d3-42e3-8ac4-fe0934602e37'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.519853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] The token cache is being invalidate because project 66cb4612eaba489c903e294675682084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:53.519853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.519853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.519853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1072/2165] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:53 2022] DELETE /identity/v3/projects/66cb4612eaba489c903e294675682084 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:53.523605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:53.534486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5ec16-c3b4-4a7e-ad68-83bd36945c2b service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:53.606114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:53.606765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:53.607042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:53.607309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] PATH_INFO: `/v3/users/50caea19ea9d406aa27edc074387dbb3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:53.608515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50caea19ea9d406aa27edc074387dbb3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:53.610436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:53.792390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:53.804264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50caea19ea9d406aa27edc074387dbb3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.804903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50caea19ea9d406aa27edc074387dbb3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.811721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50caea19ea9d406aa27edc074387dbb3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.823321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50caea19ea9d406aa27edc074387dbb3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.823966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50caea19ea9d406aa27edc074387dbb3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:53.888009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1094/2166] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:53 2022] DELETE /identity/v3/users/50caea19ea9d406aa27edc074387dbb3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:54.391176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:54.392745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:54.407127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e03ec9-46d3-42e3-8ac4-fe0934602e37 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:54.471818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:54.472475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:54.472754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:54.473023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] PATH_INFO: `/v3/projects/d91c1cb1191e46cb90e1154e6d220337` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:54.475671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91c1cb1191e46cb90e1154e6d220337)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:54.477713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:54.598963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91c1cb1191e46cb90e1154e6d220337', 'request_id': 'req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:54.606724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91c1cb1191e46cb90e1154e6d220337', 'request_id': 'req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:54.612551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91c1cb1191e46cb90e1154e6d220337', 'request_id': 'req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:54.663342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:54.664900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:54.679035 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d4f50-0a30-4057-becd-bc14aa17739d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:54.721885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] The token cache is being invalidate because project d91c1cb1191e46cb90e1154e6d220337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:54.722170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:54.722797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8cbaa8c3-15be-44c4-9128-ad08ca0eb771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:54.724688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1073/2167] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:54 2022] DELETE /identity/v3/projects/d91c1cb1191e46cb90e1154e6d220337 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:54.729082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433329a2-6a0e-49c2-8bd4-42ecddd536dc None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:54.729422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433329a2-6a0e-49c2-8bd4-42ecddd536dc None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:54.729748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433329a2-6a0e-49c2-8bd4-42ecddd536dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:54.742901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:54.743682 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:54.743962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:54.744389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] PATH_INFO: `/v3/users/0eaa8c36652247f7ad9774a7c4887f7d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:54.745534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaa8c36652247f7ad9774a7c4887f7d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:54.748020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:54.752924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-433329a2-6a0e-49c2-8bd4-42ecddd536dc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:54.754732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-433329a2-6a0e-49c2-8bd4-42ecddd536dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:54.763384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1074/2168] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:54.770595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623efca7-86a0-404a-a321-837a48bf081b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:54.770874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623efca7-86a0-404a-a321-837a48bf081b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:54.771142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623efca7-86a0-404a-a321-837a48bf081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:54.780259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:54.791543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-623efca7-86a0-404a-a321-837a48bf081b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:54.798287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-623efca7-86a0-404a-a321-837a48bf081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:54.800802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1075/2169] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:54.805441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623efca7-86a0-404a-a321-837a48bf081b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:54.814424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623efca7-86a0-404a-a321-837a48bf081b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:54.819896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:54.820531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:54.820862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:54.821070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:54.821831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:54.822136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:54.827124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:54.835652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1076/2170] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:20:54.839927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:54.852368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a010d5b-855c-48bf-9358-dcaaeb2026bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:54.858184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:54.861490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:54.861490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:54.861490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:54.861490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:54.865567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:54.994882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1077/2171] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:54 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:54.996673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.004614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaa8c36652247f7ad9774a7c4887f7d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.005453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaa8c36652247f7ad9774a7c4887f7d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.015437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaa8c36652247f7ad9774a7c4887f7d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.032358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaa8c36652247f7ad9774a7c4887f7d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.033142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-9ab63f6a-3008-4c02-a7d4-894bf8a0ed84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaa8c36652247f7ad9774a7c4887f7d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.080707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e6add-40d0-4836-ae9b-9c2f3b904b9e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.086448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.087076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.087354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.087626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.088298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.090567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.111280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1095/2172] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:54 2022] DELETE /identity/v3/users/0eaa8c36652247f7ad9774a7c4887f7d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:55.116643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.117166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.117438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.138108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:55.139330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:55.168400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:55.200011 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1078/2173] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:54 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:55.201351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.203099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:55.218029 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab5b0e-f5a5-4f8e-bb66-5048f48bdcd2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.223148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.223814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.224870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.225006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1096/2174] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:55.225160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.226137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.227846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.233724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.236164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:55.239058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1079/2175] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:55.243311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.257630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831b2c4-5105-40d1-965c-2f3731c96b6e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.263871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.264694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.265071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.265441 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.266244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.268555 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.289796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1080/2176] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:55.294154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.309094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e95b0-45ba-480f-bedf-ef8474a8b3a0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.315272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.315499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d25cd8-3bf0-4b9c-9c42-295e910e1b9b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.316110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.316454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.316798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] PATH_INFO: `/v3/projects/2d7d5057860940c6a5d8ffb64438fabc/users/8742f4b935cb436a88fd5338498ccd19/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.319559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4763bbd-a9f1-4e6a-8d9c-ed1bb30c5616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.320239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763bbd-a9f1-4e6a-8d9c-ed1bb30c5616 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.320479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763bbd-a9f1-4e6a-8d9c-ed1bb30c5616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.320746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763bbd-a9f1-4e6a-8d9c-ed1bb30c5616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.332939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4763bbd-a9f1-4e6a-8d9c-ed1bb30c5616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.334155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7d5057860940c6a5d8ffb64438fabc, user_id=8742f4b935cb436a88fd5338498ccd19, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.335018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4763bbd-a9f1-4e6a-8d9c-ed1bb30c5616 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.336909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.346301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1097/2177] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:20:55.407689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1081/2178] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:55 2022] PUT /identity/v3/projects/2d7d5057860940c6a5d8ffb64438fabc/users/8742f4b935cb436a88fd5338498ccd19/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:55.420199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.420540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.420917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.462210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] MFA Rules not processed for user `8742f4b935cb436a88fd5338498ccd19`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:55.463548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:55.543870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1098/2179] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:55.549001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.620603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2004e89-f235-44a1-ae78-a35b630101d8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.625885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.626521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.626790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.627214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.627846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.630234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.644131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:55.739724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1082/2180] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:55 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:55.743890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.756038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f387e8-f10a-4d50-ade9-f0d094636ebb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.808798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.810926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:55.813701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.814330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.814610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.814880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.815518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.818574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.827578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:55.830989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a073eab-591b-4dfc-a390-e6a15755df23 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.837159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.837798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.838105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.838330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] PATH_INFO: `/v3/projects/604724c83e7a4ab18aed1cf85c185c1c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.839557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=604724c83e7a4ab18aed1cf85c185c1c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.841448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.887845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1099/2181] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:55 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:55.891680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.902353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896aa75-71ec-49fc-9874-fdfcde0f502d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.907057 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.907666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.907939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.908285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.909002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.910509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:55.920765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1100/2182] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:55.924536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:55.934279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac267e66-f741-4596-bb55-2bdb6c44d54f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:55.944757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604724c83e7a4ab18aed1cf85c185c1c', 'request_id': 'req-94848acd-fb40-4f11-afef-5e5cd592f5a7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.951294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604724c83e7a4ab18aed1cf85c185c1c', 'request_id': 'req-94848acd-fb40-4f11-afef-5e5cd592f5a7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.956882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604724c83e7a4ab18aed1cf85c185c1c', 'request_id': 'req-94848acd-fb40-4f11-afef-5e5cd592f5a7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:55.993169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:55.993785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:55.994063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:55.994332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:55.994984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:55.996685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.007313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1101/2183] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:56.011462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.015923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] The token cache is being invalidate because project 604724c83e7a4ab18aed1cf85c185c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:56.016322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.017994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.018704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1083/2184] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:55 2022] DELETE /identity/v3/projects/604724c83e7a4ab18aed1cf85c185c1c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:56.022477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfff9d-9cb6-44ac-a9e7-dfb9809c8e4e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.022655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.024198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:56.027558 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376ac38-d917-4e1a-9033-c288528dc10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.028251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ac38-d917-4e1a-9033-c288528dc10b admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.028531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ac38-d917-4e1a-9033-c288528dc10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.028825 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376ac38-d917-4e1a-9033-c288528dc10b admin admin] PATH_INFO: `/v3/projects/59f9ce96407a4092b81ac27f9fd72adb/users/870a2af43e29496aaa8921ed0c117913/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.038148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848acd-fb40-4f11-afef-5e5cd592f5a7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.043551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.044239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.044517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.044754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376ac38-d917-4e1a-9033-c288528dc10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59f9ce96407a4092b81ac27f9fd72adb, user_id=870a2af43e29496aaa8921ed0c117913, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.044892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] PATH_INFO: `/v3/users/3867638aceb14cbf8179c85628f3dc8e` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.048161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3867638aceb14cbf8179c85628f3dc8e)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.048319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376ac38-d917-4e1a-9033-c288528dc10b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.048413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.121995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1102/2185] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:56 2022] PUT /identity/v3/projects/59f9ce96407a4092b81ac27f9fd72adb/users/870a2af43e29496aaa8921ed0c117913/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:56.132722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.133011 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.133311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.161784 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] MFA Rules not processed for user `870a2af43e29496aaa8921ed0c117913`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:56.163256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:56.205241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3867638aceb14cbf8179c85628f3dc8e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.206009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3867638aceb14cbf8179c85628f3dc8e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.207024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3867638aceb14cbf8179c85628f3dc8e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.214960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3867638aceb14cbf8179c85628f3dc8e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.227862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3867638aceb14cbf8179c85628f3dc8e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.229985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1103/2186] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:56.234500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.235791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:56.281061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1084/2187] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:56 2022] DELETE /identity/v3/users/3867638aceb14cbf8179c85628f3dc8e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:56.282116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:56.302607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b13b8-d2d4-426f-bc1c-c1d783ce8e7b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.381290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.381290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.381290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.381290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.381719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.381719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.484287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1104/2188] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:56 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:56.488334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.500047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66b6e1-3ac8-4f8b-bc9c-ec1d87a5bc45 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.550377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:56.574497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.575199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.575601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.576012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.576888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.580288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.722095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1085/2189] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:56 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:20:56.726504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.737038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f5297-1a3c-4f27-a301-cfbefe9094b6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.742413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.743027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.743301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.743572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.744269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.745907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.760622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1105/2190] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:56.762551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.764890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:56.765447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.777770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4d4a-0e88-492e-9677-df981344a369 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.782794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.783508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.783832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.784131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] PATH_INFO: `/v3/projects/bec8225b78124417b312b621f7ce2f58/users/2a77c52d12dc4766ba55a429b7932155/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.792906 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a341ce-694d-4a6a-ba01-453fc4df9342 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:56.798107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:56.798775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:56.800409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:56.800409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] PATH_INFO: `/v3/projects/6305b422e81d4202a96bc15b81385048` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:56.800626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6305b422e81d4202a96bc15b81385048)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.800715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec8225b78124417b312b621f7ce2f58, user_id=2a77c52d12dc4766ba55a429b7932155, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:56.802564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.803370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:56.902843 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1106/2191] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:56 2022] PUT /identity/v3/projects/bec8225b78124417b312b621f7ce2f58/users/2a77c52d12dc4766ba55a429b7932155/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:56.906800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:56.935984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6305b422e81d4202a96bc15b81385048', 'request_id': 'req-4369b2ea-4186-4135-800c-b6993195876a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.943141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6305b422e81d4202a96bc15b81385048', 'request_id': 'req-4369b2ea-4186-4135-800c-b6993195876a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.949188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6305b422e81d4202a96bc15b81385048', 'request_id': 'req-4369b2ea-4186-4135-800c-b6993195876a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:56.984504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278f419-aff1-411d-8a37-028a20d06840 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.001666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] The token cache is being invalidate because project 6305b422e81d4202a96bc15b81385048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:57.001956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:57.003033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4369b2ea-4186-4135-800c-b6993195876a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:57.012570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1086/2192] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:56 2022] DELETE /identity/v3/projects/6305b422e81d4202a96bc15b81385048 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:57.014363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94790be4-9918-43f8-8038-8edf8aefd8a2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.014651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94790be4-9918-43f8-8038-8edf8aefd8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.014934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94790be4-9918-43f8-8038-8edf8aefd8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.038592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:57.043976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-94790be4-9918-43f8-8038-8edf8aefd8a2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:57.045553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-94790be4-9918-43f8-8038-8edf8aefd8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.053210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.053970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.054342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.054725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.055443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.057241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:57.069390 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1107/2193] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:57.073297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:57.076897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.096336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fa45-041b-4e07-976d-2f8ffb37377b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.102671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd8639-9a7f-4d3c-87bc-ad70eabb5216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.103609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8639-9a7f-4d3c-87bc-ad70eabb5216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.104331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8639-9a7f-4d3c-87bc-ad70eabb5216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.104331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd8639-9a7f-4d3c-87bc-ad70eabb5216 admin admin] PATH_INFO: `/v3/projects/bec8225b78124417b312b621f7ce2f58/users/2a77c52d12dc4766ba55a429b7932155/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.106562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8639-9a7f-4d3c-87bc-ad70eabb5216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec8225b78124417b312b621f7ce2f58, user_id=2a77c52d12dc4766ba55a429b7932155, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.109759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd8639-9a7f-4d3c-87bc-ad70eabb5216 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:57.124533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1108/2194] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:57 2022] PUT /identity/v3/projects/bec8225b78124417b312b621f7ce2f58/users/2a77c52d12dc4766ba55a429b7932155/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:57.135849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.136162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.136443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.141038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1087/2195] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:57.149989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.150304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.150562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.180337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] MFA Rules not processed for user `2a77c52d12dc4766ba55a429b7932155`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:57.181727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.200583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:57.204827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.303088 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:57.315688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1088/2196] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:57.317328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1109/2197] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:57.321069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:57.330891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f686093-a054-473d-b5a3-2bd98c53c136 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.335928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:57.336836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.340992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.342321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.343039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.343951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.346113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:57.346617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.349637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:57.372616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1089/2198] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:57.377787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:57.391466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835426b8-74ca-4a6a-a2bd-9c3ba9631a4f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.397534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.398131 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.398422 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.398703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.399550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.402251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:57.596775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d0b4-5001-4bcb-9b9e-74f2cbfd3750 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.596775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.596775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.596775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.597280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.597280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.597280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.597280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:57.597280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1110/2199] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:57.649556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:57.651316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:57.665549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3c98e-b80e-499e-8262-6bf9dfb2eea7 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.670215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.670844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.671121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.671392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] PATH_INFO: `/v3/users/349c6d05068e405685cbace0081e4453` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.672545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349c6d05068e405685cbace0081e4453)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.674447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:57.676882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:57.843500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1090/2200] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:57 2022] POST /identity/v3/projects => generated 389 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:57.847778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:57.912139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25605c6-741c-4a21-8cf1-b8484b4931a4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:57.918480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:57.918480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:57.918697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:57.919210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:57.919860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:57.921822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.054806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349c6d05068e405685cbace0081e4453'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:58.055446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349c6d05068e405685cbace0081e4453'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:58.062607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349c6d05068e405685cbace0081e4453'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:58.075027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1091/2201] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:57 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:58.075027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.076047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349c6d05068e405685cbace0081e4453'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:58.076840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-57529fb2-4452-4e94-a474-cbf7a83b6e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349c6d05068e405685cbace0081e4453'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:58.084070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068247f-e64d-4a8a-8e5d-19f0dc94e86d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.088825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.089448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.089721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.089988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.090626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.092346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.103511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1092/2202] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:58.106784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.108498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:58.121320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e035e22-44ba-41af-96e3-4e9311458c30 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.125864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.126793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.126793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.127015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.127616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.129225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.139300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1093/2203] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:20:58.143277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.152572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5172e3-92ac-460a-9099-b2ac075fd0f3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.157133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c009c-a4e1-4dc2-9f47-b1dece38f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.157768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c009c-a4e1-4dc2-9f47-b1dece38f450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.158045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c009c-a4e1-4dc2-9f47-b1dece38f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.158314 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c009c-a4e1-4dc2-9f47-b1dece38f450 admin admin] PATH_INFO: `/v3/projects/853f6211d4cd41229b826865b591b6f7/users/57292ca1f45b44f18ad4cad8bfcd8e14/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.168625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1111/2204] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:57 2022] DELETE /identity/v3/users/349c6d05068e405685cbace0081e4453 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:58.173182 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.173472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.173744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.176956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c009c-a4e1-4dc2-9f47-b1dece38f450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853f6211d4cd41229b826865b591b6f7, user_id=57292ca1f45b44f18ad4cad8bfcd8e14, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.180352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c009c-a4e1-4dc2-9f47-b1dece38f450 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.193204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:58.194401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:58.258665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1112/2205] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:58.269745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.270315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:58.271406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1094/2206] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:58 2022] PUT /identity/v3/projects/853f6211d4cd41229b826865b591b6f7/users/57292ca1f45b44f18ad4cad8bfcd8e14/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:58.282859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.292848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.292848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.319981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] MFA Rules not processed for user `57292ca1f45b44f18ad4cad8bfcd8e14`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:58.319981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:58.341068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c2a9-1b1e-43aa-97b9-a71003c4751f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.381474 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:58.387201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:58.392201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1095/2207] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:58.397064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.402041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.402662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.402938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.403205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.459882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de977a-c350-444a-8e17-7d9556797c40 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.464600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.465198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.465377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.465494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.465725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.466356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.466926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.468293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.478238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1113/2208] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:58.540901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1096/2209] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:58 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:58.545768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.556350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96722a28-e9c4-4ea9-bb9a-aa8090fa9900 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.621392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.622035 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.622313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.622585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.623219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.625180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.783026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1114/2210] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:58 2022] POST /identity/v3/users => generated 300 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:58.784224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.795623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7054-4d2c-4c87-82cf-e93cb85c14dd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.811142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.811781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.812063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.815243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.816031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.818453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.838465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1097/2211] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:58.842599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.871492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c7d16-99d2-4278-b82d-8815419d281f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:58.876452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:58.877106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:58.877378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:58.877645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] PATH_INFO: `/v3/projects/be782032d0044813830b91d4695f1bae/users/e8bbf9e097334c82addeab9442c42ef6/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:58.894141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be782032d0044813830b91d4695f1bae, user_id=e8bbf9e097334c82addeab9442c42ef6, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:58.897629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:58.972105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1115/2212] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:58 2022] PUT /identity/v3/projects/be782032d0044813830b91d4695f1bae/users/e8bbf9e097334c82addeab9442c42ef6/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:20:58.976222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:58.986179 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657259d-4d4f-4456-97d3-d280aa42d81e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.003412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.005753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.061805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.062639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.062976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.063312 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.064028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.065991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.076310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d6731-39b1-41ef-a82b-43bd51f75f18 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.077401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1098/2213] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:59.081392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.081551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.082028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.082305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.082576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] PATH_INFO: `/v3/projects/cbd98322e1b7485e8d74afdce0998fde` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.083751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd98322e1b7485e8d74afdce0998fde)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.085698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.092381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc914d-e3a2-46dc-a397-c06c2bbe1965 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.097285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d351c1-da31-43bd-b7be-255ac8b1c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.097970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d351c1-da31-43bd-b7be-255ac8b1c0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.098246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d351c1-da31-43bd-b7be-255ac8b1c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.098662 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d351c1-da31-43bd-b7be-255ac8b1c0b8 admin admin] PATH_INFO: `/v3/projects/be782032d0044813830b91d4695f1bae/users/e8bbf9e097334c82addeab9442c42ef6/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.100654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d351c1-da31-43bd-b7be-255ac8b1c0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be782032d0044813830b91d4695f1bae, user_id=e8bbf9e097334c82addeab9442c42ef6, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.103401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d351c1-da31-43bd-b7be-255ac8b1c0b8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.113862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1099/2214] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:20:59 2022] PUT /identity/v3/projects/be782032d0044813830b91d4695f1bae/users/e8bbf9e097334c82addeab9442c42ef6/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:59.125337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.125612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.125888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.141778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:59.153892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] MFA Rules not processed for user `e8bbf9e097334c82addeab9442c42ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:59.155096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.199080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:59.224196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1100/2215] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:59.230588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd98322e1b7485e8d74afdce0998fde', 'request_id': 'req-6fc14656-38f4-4238-bf70-7d920f14afa3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.234786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.236138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.237219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd98322e1b7485e8d74afdce0998fde', 'request_id': 'req-6fc14656-38f4-4238-bf70-7d920f14afa3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.243290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd98322e1b7485e8d74afdce0998fde', 'request_id': 'req-6fc14656-38f4-4238-bf70-7d920f14afa3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.292867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dd9a7-9a64-44ac-af21-a92d517a4e5f None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.314535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] The token cache is being invalidate because project cbd98322e1b7485e8d74afdce0998fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:20:59.315130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.316340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fc14656-38f4-4238-bf70-7d920f14afa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.318701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1116/2216] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:20:59 2022] DELETE /identity/v3/projects/cbd98322e1b7485e8d74afdce0998fde => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:20:59.323751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc51-1852-4004-ac39-cda87ee3e574 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.324174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc51-1852-4004-ac39-cda87ee3e574 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.324617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138cc51-1852-4004-ac39-cda87ee3e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.345955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a138cc51-1852-4004-ac39-cda87ee3e574 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:59.347175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a138cc51-1852-4004-ac39-cda87ee3e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.348188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.349065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.349552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.349960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.351919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.418953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1117/2217] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:20:59.419158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.419158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.421610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.421893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.422165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.429661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1101/2218] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:20:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:20:59.442677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:20:59.446056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.456009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1118/2219] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:20:59.460403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.471919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545c266-b032-4fd5-ac9d-ae645d373da2 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.477624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.478382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.478717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.479114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.480425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:20:59.480425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.482137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.496098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1102/2220] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:20:59.500295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.509934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872aae8-d251-43d5-8a24-236520a1b69a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.516565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.516565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.516565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.516565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.517135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.518900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.574778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.580196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:20:59.589875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac648c33-f87f-402e-989e-5126cbbe393d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.594984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.595606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.595882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.596186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] PATH_INFO: `/v3/users/57292ca1f45b44f18ad4cad8bfcd8e14` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.597311 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57292ca1f45b44f18ad4cad8bfcd8e14)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.600248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.608964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1119/2221] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:20:59 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:59.613016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.672318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:59.678152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26afe7-941d-4968-a920-798b27001632 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.683209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.687305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.687305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.687305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.687305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.687305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.740669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:20:59.903033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1120/2222] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:20:59 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:20:59.906482 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.931855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91912f7-a0cf-477b-8946-e95e6999a76f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.937886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.938501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.938774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.939041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.939684 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.941319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.951588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1121/2223] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:20:59.955595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:20:59.968541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac314bfd-0fde-45d6-a20e-49feb2602ad4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:20:59.972740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57292ca1f45b44f18ad4cad8bfcd8e14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.973627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:20:59.974436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57292ca1f45b44f18ad4cad8bfcd8e14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.975166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:20:59.975479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57292ca1f45b44f18ad4cad8bfcd8e14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.975603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:20:59.975964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:20:59.976870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:20:59.978530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:20:59.983965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57292ca1f45b44f18ad4cad8bfcd8e14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:20:59.998232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dcf7307e-25d4-4da3-a4b3-2e3eceb02ca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57292ca1f45b44f18ad4cad8bfcd8e14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:00.122152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1122/2224] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:00.123394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:00.125161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.135393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1103/2225] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:20:59 2022] DELETE /identity/v3/users/57292ca1f45b44f18ad4cad8bfcd8e14 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:00.138877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555ef66-dc45-417a-94aa-8d476e98cee7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:00.139873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.140222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.140686 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.160168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:00.161451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.196119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1dca6e-9718-4f61-8d3c-de555cc6f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:00.196706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dca6e-9718-4f61-8d3c-de555cc6f7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.196973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dca6e-9718-4f61-8d3c-de555cc6f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.197233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1dca6e-9718-4f61-8d3c-de555cc6f7e3 admin admin] PATH_INFO: `/v3/projects/54c4facf792d4675a4fe0a97c2451066/users/c1bc0ae9259d4669b9037317df055b6f/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.213186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dca6e-9718-4f61-8d3c-de555cc6f7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c4facf792d4675a4fe0a97c2451066, user_id=c1bc0ae9259d4669b9037317df055b6f, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:00.215859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1dca6e-9718-4f61-8d3c-de555cc6f7e3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:00.219917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1104/2226] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:00.229905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:00.231223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.287006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b8911-de73-4b56-bc0e-9f5b903bd50d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:00.290583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:00.291173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.291449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.291810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.300427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:00.301953 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:00.309006 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1123/2227] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:00 2022] PUT /identity/v3/projects/54c4facf792d4675a4fe0a97c2451066/users/c1bc0ae9259d4669b9037317df055b6f/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:00.313984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.320444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1105/2228] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:00.320594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.320594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.334109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:00.335301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.401814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1124/2229] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:00.412225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:00.413654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.425250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127396-9ee8-49dd-bc8f-8f4055b85ba1 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:00.493898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:00.501114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:00.502004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.502318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.502618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.519548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:00.519548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:00.527703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1106/2230] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:00.693520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:00.694936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.746337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:00.751726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca94b5-3152-44c2-9ce6-f748f02d18f8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:00.756075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:00.756704 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.757087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.757357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.759129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.781413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:00.782831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:00.796351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae3c27-6139-4883-a06d-2ae2cef79411 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:00.802890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:00.803534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:00.804346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:00.804346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] PATH_INFO: `/v3/projects/853f6211d4cd41229b826865b591b6f7` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:00.805506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853f6211d4cd41229b826865b591b6f7)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:00.807358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:00.835228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:00.837193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:00.850192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1125/2231] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:00.975400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853f6211d4cd41229b826865b591b6f7', 'request_id': 'req-a12246e3-f277-4457-a040-51e8cde35168'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:00.982657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853f6211d4cd41229b826865b591b6f7', 'request_id': 'req-a12246e3-f277-4457-a040-51e8cde35168'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:00.990844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853f6211d4cd41229b826865b591b6f7', 'request_id': 'req-a12246e3-f277-4457-a040-51e8cde35168'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.097785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] The token cache is being invalidate because project 853f6211d4cd41229b826865b591b6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:01.103897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.103897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.103897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1107/2232] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:00 2022] DELETE /identity/v3/projects/853f6211d4cd41229b826865b591b6f7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:01.105397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:01.118300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2238c49-4864-4eb9-b3da-9d5a0f9d81ab service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:01.174507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:01.175080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:01.175324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:01.175778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] PATH_INFO: `/v3/users/e8bbf9e097334c82addeab9442c42ef6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:01.177859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bbf9e097334c82addeab9442c42ef6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:01.179906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:01.370990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bbf9e097334c82addeab9442c42ef6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.371748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bbf9e097334c82addeab9442c42ef6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.379245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bbf9e097334c82addeab9442c42ef6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.392021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bbf9e097334c82addeab9442c42ef6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.392774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a03cc8b4-d4e6-45ec-9651-b3314a8bb296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bbf9e097334c82addeab9442c42ef6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:01.492444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1126/2233] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:01 2022] DELETE /identity/v3/users/e8bbf9e097334c82addeab9442c42ef6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:02.039384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.042627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:02.064734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12246e3-f277-4457-a040-51e8cde35168 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:02.127298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:02.127940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.128262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.128587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] PATH_INFO: `/v3/projects/be782032d0044813830b91d4695f1bae` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.129720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be782032d0044813830b91d4695f1bae)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:02.132403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:02.185546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e8a94-1fd1-434b-837a-2b86a3c6d1cb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.186426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e8a94-1fd1-434b-837a-2b86a3c6d1cb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.187239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e8a94-1fd1-434b-837a-2b86a3c6d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.250694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6a6e8a94-1fd1-434b-837a-2b86a3c6d1cb None None] MFA Rules not processed for user `c1bc0ae9259d4669b9037317df055b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:02.251960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6a6e8a94-1fd1-434b-837a-2b86a3c6d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:02.262465 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:02.269636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be782032d0044813830b91d4695f1bae', 'request_id': 'req-2e9d06f7-f138-4d3d-92b6-65f336499ae3'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:02.276349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be782032d0044813830b91d4695f1bae', 'request_id': 'req-2e9d06f7-f138-4d3d-92b6-65f336499ae3'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:02.282626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be782032d0044813830b91d4695f1bae', 'request_id': 'req-2e9d06f7-f138-4d3d-92b6-65f336499ae3'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:02.336840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1127/2234] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:02.412362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] The token cache is being invalidate because project be782032d0044813830b91d4695f1bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:02.412650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:02.413390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:02.415061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1108/2235] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:02 2022] DELETE /identity/v3/projects/be782032d0044813830b91d4695f1bae => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:02.420183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d657-ecb7-441e-bd50-7565372d17d6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.420493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d657-ecb7-441e-bd50-7565372d17d6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.420761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242d657-ecb7-441e-bd50-7565372d17d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.443579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c242d657-ecb7-441e-bd50-7565372d17d6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:02.444892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c242d657-ecb7-441e-bd50-7565372d17d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:02.472804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.474704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:02.481464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:02.509421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1128/2236] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:02.517120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.517403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.517674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.537901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d06f7-f138-4d3d-92b6-65f336499ae3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:02.539114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:02.540392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:02.541765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:02.542398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.542672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.542935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.544641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:02.548528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1129/2237] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:02.553494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.557328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:02.559833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:02.562615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e00a0-46ef-4a5a-b7f9-bc259dc25ba3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:02.567901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:02.568400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1109/2238] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:02.570250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.570572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.570885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.571544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:02.571849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:02.573509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:02.587367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1130/2239] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:21:02.591992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.604226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1c165-bd75-49ed-be61-3110d01b9c25 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:02.609213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:02.610000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.610273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.610574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.611305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:02.613110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:02.746416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1110/2240] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:02 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:02.750721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.762111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce816b-3c04-4572-a760-a65bcc2cb51d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:02.818927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:02.819460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.819728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.819991 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.820635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:02.822568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:02.944525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1131/2241] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:02 2022] POST /identity/v3/users => generated 305 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:02.950094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.960393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2c101-5196-4405-aea6-6969418be4b9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:02.966987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:02.968434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:02.973522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:02.973522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:02.973522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:02.973522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:02.982875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1111/2242] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:02.986953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:02.997494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167fa39-349a-40a9-ab7b-ae093326a378 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.011871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.012585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.012923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.013323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.014129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.015846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.028958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1132/2243] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:03.033542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.045027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2feba8-d412-4710-821b-dcced9bfd322 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.049801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd08e8-be8c-419a-a00d-ac340a85db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.050656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd08e8-be8c-419a-a00d-ac340a85db46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.050976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd08e8-be8c-419a-a00d-ac340a85db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.056214 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd08e8-be8c-419a-a00d-ac340a85db46 admin admin] PATH_INFO: `/v3/projects/b52ceeff83bc4067a745c8cfbe63ec06/users/32836930eb9641c9a4312cb708d2f49d/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.069754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd08e8-be8c-419a-a00d-ac340a85db46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52ceeff83bc4067a745c8cfbe63ec06, user_id=32836930eb9641c9a4312cb708d2f49d, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.072829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd08e8-be8c-419a-a00d-ac340a85db46 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.115672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.116108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:03.173342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee57ac-49ff-4406-8b6f-46662029cb40 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.177140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.177749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.178038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.178289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.180122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:03.187674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1112/2244] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:03 2022] PUT /identity/v3/projects/b52ceeff83bc4067a745c8cfbe63ec06/users/32836930eb9641c9a4312cb708d2f49d/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:03.199190 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.199571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.199745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.227781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] MFA Rules not processed for user `32836930eb9641c9a4312cb708d2f49d`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:03.235761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:03.246254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.247738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.258434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1133/2245] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:03.295870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1113/2246] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:03 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:03.300481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.311592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48348b9e-32ce-4b72-9b7f-c279999553b6 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.381157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.381870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.382216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.382554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.383254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.385197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.508024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1134/2247] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:03 2022] POST /identity/v3/projects => generated 409 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:03.511753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.524047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0167c-dfde-4a96-8ad2-14f611bcfd00 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.600186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.600756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.601136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.601411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.602044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.604034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.728015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1114/2248] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:03 2022] POST /identity/v3/users => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:03.737258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.748497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c6deb-1480-416d-8a43-bb631c00c724 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.753175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.753780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.754054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.754319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.755505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.757205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.767264 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1135/2249] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:03.772005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.782668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecf27f-f54b-4281-b479-96212a2d7377 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:03.788785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:03.789466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:03.789748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:03.790033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] PATH_INFO: `/v3/projects/45433fec78ca4f12bcf1b9b23cb9d129/users/6e510be6d73640b98e244c3713adec66/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:03.805560 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45433fec78ca4f12bcf1b9b23cb9d129, user_id=6e510be6d73640b98e244c3713adec66, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:03.808440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:03.932418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:03.938215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1115/2250] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:03 2022] PUT /identity/v3/projects/45433fec78ca4f12bcf1b9b23cb9d129/users/6e510be6d73640b98e244c3713adec66/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:03.942290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:03.952598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c84f0f-b036-4c32-bc45-9bd2cf6100df admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:04.008896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3afcbd-6e04-4724-8fe7-b2d883bfcf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:04.009551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3afcbd-6e04-4724-8fe7-b2d883bfcf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:04.009826 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3afcbd-6e04-4724-8fe7-b2d883bfcf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:04.010094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3afcbd-6e04-4724-8fe7-b2d883bfcf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:04.010727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3afcbd-6e04-4724-8fe7-b2d883bfcf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:04.012325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3afcbd-6e04-4724-8fe7-b2d883bfcf2e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:04.022391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1136/2251] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:04.027071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:04.038089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e3fe6-ab5b-44a5-b80f-fadc3fc567bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:04.042805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:04.043458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:04.043733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:04.043999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] PATH_INFO: `/v3/projects/45433fec78ca4f12bcf1b9b23cb9d129/users/6e510be6d73640b98e244c3713adec66/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:04.046092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45433fec78ca4f12bcf1b9b23cb9d129, user_id=6e510be6d73640b98e244c3713adec66, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:04.048957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:04.059435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1116/2252] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:04 2022] PUT /identity/v3/projects/45433fec78ca4f12bcf1b9b23cb9d129/users/6e510be6d73640b98e244c3713adec66/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:04.070391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:04.070539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:04.070807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:04.099207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] MFA Rules not processed for user `6e510be6d73640b98e244c3713adec66`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:04.100462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:04.167675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1137/2253] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:04 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:04.182569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:04.228765 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:04.244998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712d9d2-3c82-4dca-b0e3-8024e49d1ec1 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:04.248664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dcbb0-3b13-44c2-a309-406cb821ca19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:04.249318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dcbb0-3b13-44c2-a309-406cb821ca19 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:04.249585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dcbb0-3b13-44c2-a309-406cb821ca19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:04.249846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dcbb0-3b13-44c2-a309-406cb821ca19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:04.259901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dcbb0-3b13-44c2-a309-406cb821ca19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:04.261466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dcbb0-3b13-44c2-a309-406cb821ca19 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:04.271118 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1117/2254] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:04 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:04.572758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:04.624853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:04.635165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657621f-a0d9-4617-895e-6e86f190eaf3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:04.638733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:04.639329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:04.639600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:04.639866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:04.698507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:04.699954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:04.708963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1138/2255] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:04 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:05.538667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ba83-eefd-4f20-acba-727bcb4717e3 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:05.539114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ba83-eefd-4f20-acba-727bcb4717e3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:05.539193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7ba83-eefd-4f20-acba-727bcb4717e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:05.681914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-82d7ba83-eefd-4f20-acba-727bcb4717e3 None None] MFA Rules not processed for user `c1bc0ae9259d4669b9037317df055b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:05.683122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-82d7ba83-eefd-4f20-acba-727bcb4717e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:05.747376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1118/2256] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:09.198689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:09.200159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:09.253018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:09.265869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29240487-1f98-4af3-ace3-16c08e04304f service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:09.270492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:09.271118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:09.271392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:09.271657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] PATH_INFO: `/v3/users/8742f4b935cb436a88fd5338498ccd19` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:09.272797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8742f4b935cb436a88fd5338498ccd19)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:09.274733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:09.469526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8742f4b935cb436a88fd5338498ccd19'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:09.470419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8742f4b935cb436a88fd5338498ccd19'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:09.478662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8742f4b935cb436a88fd5338498ccd19'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:09.492831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8742f4b935cb436a88fd5338498ccd19'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:09.493002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8742f4b935cb436a88fd5338498ccd19'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:09.601455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1139/2257] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:09 2022] DELETE /identity/v3/users/8742f4b935cb436a88fd5338498ccd19 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:09.605924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:09.606378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:09.606470 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:09.624964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:09.626153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:09.672708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:09.709887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1119/2258] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:09.720738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:09.722310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:09.804635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66496bb0-875e-4fcc-84e9-dc15fcaf186d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:09.810090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:09.810090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:09.810090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:09.810090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:09.822121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:09.823612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:09.835955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1140/2259] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:10.373495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:10.375003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:10.389102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399d1c4-a794-4e7b-9d5a-72ce3db9a78b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:10.393957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:10.394586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:10.394858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:10.397023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] PATH_INFO: `/v3/projects/2d7d5057860940c6a5d8ffb64438fabc` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:10.397023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7d5057860940c6a5d8ffb64438fabc)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:10.398719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:10.506955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7d5057860940c6a5d8ffb64438fabc', 'request_id': 'req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.517967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7d5057860940c6a5d8ffb64438fabc', 'request_id': 'req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.524618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7d5057860940c6a5d8ffb64438fabc', 'request_id': 'req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.623490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] The token cache is being invalidate because project 2d7d5057860940c6a5d8ffb64438fabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:10.624158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.624653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.626155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1120/2260] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:10 2022] DELETE /identity/v3/projects/2d7d5057860940c6a5d8ffb64438fabc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:10.630696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:10.640608 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a024ca7-9c59-44f9-bf0d-5df9f15f88f3 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:10.706564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:10.707117 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:10.707393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:10.708351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] PATH_INFO: `/v3/users/870a2af43e29496aaa8921ed0c117913` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:10.709415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870a2af43e29496aaa8921ed0c117913)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:10.711355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:10.727562 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:10.940021 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870a2af43e29496aaa8921ed0c117913'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.940733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870a2af43e29496aaa8921ed0c117913'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.948357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870a2af43e29496aaa8921ed0c117913'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.968851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870a2af43e29496aaa8921ed0c117913'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:10.968851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870a2af43e29496aaa8921ed0c117913'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:11.063146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1141/2261] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:10 2022] DELETE /identity/v3/users/870a2af43e29496aaa8921ed0c117913 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:11.489543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:11.489807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:11.503348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc65e-d1ef-43e8-b56e-3e40de2e6ad1 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:11.567265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:11.567915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:11.568348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:11.568670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] PATH_INFO: `/v3/projects/59f9ce96407a4092b81ac27f9fd72adb` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:11.570196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59f9ce96407a4092b81ac27f9fd72adb)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:11.573024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:11.698287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59f9ce96407a4092b81ac27f9fd72adb', 'request_id': 'req-1fdaa792-e34d-4a5c-9a9e-e562507da633'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:11.704801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59f9ce96407a4092b81ac27f9fd72adb', 'request_id': 'req-1fdaa792-e34d-4a5c-9a9e-e562507da633'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:11.710419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59f9ce96407a4092b81ac27f9fd72adb', 'request_id': 'req-1fdaa792-e34d-4a5c-9a9e-e562507da633'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:11.713396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:11.794482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] The token cache is being invalidate because project 59f9ce96407a4092b81ac27f9fd72adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:11.794750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:11.795399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:11.796952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1121/2262] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:11 2022] DELETE /identity/v3/projects/59f9ce96407a4092b81ac27f9fd72adb => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:11.802876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:11.804529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:11.816985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e6855-62de-4246-8a1c-b37038637729 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:11.876971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:11.877609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:11.877881 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:11.878145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] PATH_INFO: `/v3/users/2a77c52d12dc4766ba55a429b7932155` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:11.879429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a77c52d12dc4766ba55a429b7932155)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:11.881598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:12.059833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a77c52d12dc4766ba55a429b7932155'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.060480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a77c52d12dc4766ba55a429b7932155'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.067602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a77c52d12dc4766ba55a429b7932155'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.079406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a77c52d12dc4766ba55a429b7932155'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.080047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a77c52d12dc4766ba55a429b7932155'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.143409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1142/2263] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:11 2022] DELETE /identity/v3/users/2a77c52d12dc4766ba55a429b7932155 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:12.660381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:12.666129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:12.694776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaa792-e34d-4a5c-9a9e-e562507da633 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:12.774050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:12.774970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:12.775066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:12.775279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] PATH_INFO: `/v3/projects/bec8225b78124417b312b621f7ce2f58` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:12.776450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec8225b78124417b312b621f7ce2f58)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:12.778614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:12.965182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec8225b78124417b312b621f7ce2f58', 'request_id': 'req-0c004f0c-3f67-4749-906d-e5b29860048a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.971333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec8225b78124417b312b621f7ce2f58', 'request_id': 'req-0c004f0c-3f67-4749-906d-e5b29860048a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:12.981480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec8225b78124417b312b621f7ce2f58', 'request_id': 'req-0c004f0c-3f67-4749-906d-e5b29860048a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:13.075276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] The token cache is being invalidate because project bec8225b78124417b312b621f7ce2f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:13.075567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:13.076247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c004f0c-3f67-4749-906d-e5b29860048a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:13.077909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1122/2264] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:12 2022] DELETE /identity/v3/projects/bec8225b78124417b312b621f7ce2f58 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:14.058218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:14.060458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:14.077930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fb8e3-a679-431a-8352-42d61575cf13 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:14.091152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:14.169797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:14.170432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:14.170705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:14.171028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] PATH_INFO: `/v3/users/32836930eb9641c9a4312cb708d2f49d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:14.172175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32836930eb9641c9a4312cb708d2f49d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:14.174122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:14.416041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32836930eb9641c9a4312cb708d2f49d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:14.417098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32836930eb9641c9a4312cb708d2f49d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:14.429930 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32836930eb9641c9a4312cb708d2f49d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:14.452626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32836930eb9641c9a4312cb708d2f49d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:14.453686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32836930eb9641c9a4312cb708d2f49d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:14.565599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1143/2265] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:14 2022] DELETE /identity/v3/users/32836930eb9641c9a4312cb708d2f49d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:14.570628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:14.571078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:14.571195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:14.600075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:14.600075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:14.663864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1123/2266] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:14.674149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:14.675405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:14.735575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330cac0-81c4-40c7-aa30-c056481e1946 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:14.739914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:14.740615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:14.741017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:14.741336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:14.752995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:14.755105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:14.767343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1144/2267] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:15.270568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:15.271994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:15.284398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2aaa8-2ba2-41bb-91ca-4f37fa88ac35 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:15.290447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:15.291218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:15.291560 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:15.291922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] PATH_INFO: `/v3/projects/b52ceeff83bc4067a745c8cfbe63ec06` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:15.293792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52ceeff83bc4067a745c8cfbe63ec06)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:15.295799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:15.318424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:15.396811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52ceeff83bc4067a745c8cfbe63ec06', 'request_id': 'req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.403251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52ceeff83bc4067a745c8cfbe63ec06', 'request_id': 'req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.409184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52ceeff83bc4067a745c8cfbe63ec06', 'request_id': 'req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.497269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] The token cache is being invalidate because project b52ceeff83bc4067a745c8cfbe63ec06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:15.504704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.504704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.504704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1124/2268] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:15 2022] DELETE /identity/v3/projects/b52ceeff83bc4067a745c8cfbe63ec06 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:15.506213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:15.517292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915cbe-cafe-4093-ae8a-e55625c114fe service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:15.556370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:15.581109 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:15.581750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:15.582028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:15.582318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] PATH_INFO: `/v3/users/6e510be6d73640b98e244c3713adec66` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:15.583441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e510be6d73640b98e244c3713adec66)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:15.585376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:15.876783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e510be6d73640b98e244c3713adec66'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.877436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e510be6d73640b98e244c3713adec66'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.884864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e510be6d73640b98e244c3713adec66'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.897425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e510be6d73640b98e244c3713adec66'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.898073 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5ab73447-3842-4105-b8c7-68b40d8d0e55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e510be6d73640b98e244c3713adec66'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:15.977460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1145/2269] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:15 2022] DELETE /identity/v3/users/6e510be6d73640b98e244c3713adec66 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:16.407321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:16.408813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:16.431927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90cbfe-faf9-4a1f-bee7-bf68cedebfd7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:16.489614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:16.490253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:16.490524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:16.490791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] PATH_INFO: `/v3/projects/45433fec78ca4f12bcf1b9b23cb9d129` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:16.492298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45433fec78ca4f12bcf1b9b23cb9d129)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:16.494159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:16.607989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45433fec78ca4f12bcf1b9b23cb9d129', 'request_id': 'req-8903e95c-679d-43b2-a0cb-a4e332bfe079'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:16.614332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45433fec78ca4f12bcf1b9b23cb9d129', 'request_id': 'req-8903e95c-679d-43b2-a0cb-a4e332bfe079'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:16.620305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45433fec78ca4f12bcf1b9b23cb9d129', 'request_id': 'req-8903e95c-679d-43b2-a0cb-a4e332bfe079'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:16.731274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] The token cache is being invalidate because project 45433fec78ca4f12bcf1b9b23cb9d129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:16.731572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:16.732261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-8903e95c-679d-43b2-a0cb-a4e332bfe079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:16.733938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1125/2270] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:16 2022] DELETE /identity/v3/projects/45433fec78ca4f12bcf1b9b23cb9d129 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:16.738911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:16.739407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:16.739407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:16.760102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:16.761328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:16.824580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1146/2271] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:16.833222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:16.833499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:16.833794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:16.857525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:16.858757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:16.867524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:16.869085 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1126/2272] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:16.869344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:16.873263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:16.882737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27994cb-42b8-4e2c-9e13-457ff7e38ccd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:16.884123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218278e4-c519-4d91-b369-ba5fd0510c54 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:16.887541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:16.888204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:16.888476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:16.888829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] PATH_INFO: `/v3/users/a238069e6db74579aabbb59ff0b8ef00` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:16.889768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:16.890125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a238069e6db74579aabbb59ff0b8ef00)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:16.890508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:16.890857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:16.891260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:16.891989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:16.892148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:16.892344 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:16.894095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:16.909647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1127/2273] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:21:16.914365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:16.924454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a01232-f5fc-4a41-b69f-4e35be79158c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:16.929104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:16.929719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:16.930199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:16.930318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:16.930892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:16.932864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:16.949781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:17.025191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1128/2274] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:16 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:21:17.029397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.072107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a238069e6db74579aabbb59ff0b8ef00'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.072876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a238069e6db74579aabbb59ff0b8ef00'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.075064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:17.080794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a238069e6db74579aabbb59ff0b8ef00'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.091489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68036ca2-8764-4afd-a501-223a159950b6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.093328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a238069e6db74579aabbb59ff0b8ef00'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.094048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-046d04be-f505-4628-90ec-998ca901eeaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a238069e6db74579aabbb59ff0b8ef00'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:17.096481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.097073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.097259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.097524 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.098181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.100076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.149262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1147/2275] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:16 2022] DELETE /identity/v3/users/a238069e6db74579aabbb59ff0b8ef00 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:17.153961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.154247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.154520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.174743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:17.176515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:17.183558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1129/2276] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:17 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:17.188820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.189285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:17.201710 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61af465-30bc-4a2c-be62-6550044e56ac admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.243232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1148/2277] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:17.252938 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.254900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:17.265293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.265891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.266196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.266475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.267119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.268846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.286183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1130/2278] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:17.290462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.302661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebaa76c-7068-48c3-b140-7548d3d3a3bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.307717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.308351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.308621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.308886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.309545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.311242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.317337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2f41-0557-436f-9991-b7e63df6f912 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.320831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f8412-41be-41fa-a35e-6935aaf5e1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.321438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f8412-41be-41fa-a35e-6935aaf5e1be service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.321717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f8412-41be-41fa-a35e-6935aaf5e1be service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.322167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f8412-41be-41fa-a35e-6935aaf5e1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.322324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1131/2279] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:17.326261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.332968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f8412-41be-41fa-a35e-6935aaf5e1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.334518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f8412-41be-41fa-a35e-6935aaf5e1be service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.336766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8174e-ac95-4dee-bf97-15468b72232e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.341577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.342213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.342485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.342753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] PATH_INFO: `/v3/projects/c8af2eeec6e4401c9c71a1705a0f4cb2/users/f20b24dc26174b41b3b2cf2f028dc38e/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.344655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1149/2280] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:17.358778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8af2eeec6e4401c9c71a1705a0f4cb2, user_id=f20b24dc26174b41b3b2cf2f028dc38e, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.361483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.451167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1132/2281] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:17 2022] PUT /identity/v3/projects/c8af2eeec6e4401c9c71a1705a0f4cb2/users/f20b24dc26174b41b3b2cf2f028dc38e/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:17.462345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.462635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.462912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.491311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] MFA Rules not processed for user `f20b24dc26174b41b3b2cf2f028dc38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:17.492601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:17.555048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:17.559212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1150/2282] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:17.563745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.616354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:17.631542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bed8-f4e4-46c4-909f-c6493c20c972 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.636462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.637199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.637478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.637747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.638379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.640429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.796103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1133/2283] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:17 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:17.800107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.811062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b41ce0-1fa9-4eb8-adc2-e54fa2b7843f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.847034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.849336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:17.886050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.887144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.887481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.887772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.888443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.890765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.924895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43737f3-65b1-43f5-8ee8-683397db0ee3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.930229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.930898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.931195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.931458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] PATH_INFO: `/v3/projects/c0989c06e7a9437298a39fe5b494bf68` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.932625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0989c06e7a9437298a39fe5b494bf68)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.934523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.955353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1151/2284] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:17 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:17.960199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:17.978360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07ce7f-a570-4d61-a494-47ff761b2738 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:17.980234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:17.981035 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:17.981479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:17.981915 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:17.982857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:17.984654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:17.996605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1152/2285] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:18.000910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.011119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb6600-806a-483a-82b2-1b933037fad1 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.025623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0989c06e7a9437298a39fe5b494bf68', 'request_id': 'req-b5901f56-82af-4604-8747-7c411a15a3c7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.034249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0989c06e7a9437298a39fe5b494bf68', 'request_id': 'req-b5901f56-82af-4604-8747-7c411a15a3c7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.043626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0989c06e7a9437298a39fe5b494bf68', 'request_id': 'req-b5901f56-82af-4604-8747-7c411a15a3c7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.070820 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.071489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.071765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.072038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] PATH_INFO: `/v3/projects/239f91377072484c8368a31c076a09cd/users/497b2364a4754149aa499c61843284db/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.086177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239f91377072484c8368a31c076a09cd, user_id=497b2364a4754149aa499c61843284db, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.089054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.161954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1153/2286] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:17 2022] PUT /identity/v3/projects/239f91377072484c8368a31c076a09cd/users/497b2364a4754149aa499c61843284db/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:18.163376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] The token cache is being invalidate because project c0989c06e7a9437298a39fe5b494bf68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:18.163865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.165377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-b5901f56-82af-4604-8747-7c411a15a3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:18.166588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.168277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1134/2287] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:17 2022] DELETE /identity/v3/projects/c0989c06e7a9437298a39fe5b494bf68 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:18.168424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.174157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb907-e99e-4a4c-b95d-d57601e1e373 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.174792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb907-e99e-4a4c-b95d-d57601e1e373 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.174792 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fb907-e99e-4a4c-b95d-d57601e1e373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.196886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-280fb907-e99e-4a4c-b95d-d57601e1e373 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:18.198604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-280fb907-e99e-4a4c-b95d-d57601e1e373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.234527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88205894-c65f-4f78-adb4-70561a356c99 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.239953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.240597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.241758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.241758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.241954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.243408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.257461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1154/2288] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:18.261173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.276459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1135/2289] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:18.276734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbd679-797c-4119-9eb1-e1fe220b4b30 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.279680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.280077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.287502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.288121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2f2b-b4be-4e98-ba6b-11f95fb83a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.288121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2f2b-b4be-4e98-ba6b-11f95fb83a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.288121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2f2b-b4be-4e98-ba6b-11f95fb83a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.288121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2f2b-b4be-4e98-ba6b-11f95fb83a8d admin admin] PATH_INFO: `/v3/projects/239f91377072484c8368a31c076a09cd/users/497b2364a4754149aa499c61843284db/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.288418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2f2b-b4be-4e98-ba6b-11f95fb83a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=239f91377072484c8368a31c076a09cd, user_id=497b2364a4754149aa499c61843284db, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.288418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2f2b-b4be-4e98-ba6b-11f95fb83a8d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.288543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:18.301189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1155/2290] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:18 2022] PUT /identity/v3/projects/239f91377072484c8368a31c076a09cd/users/497b2364a4754149aa499c61843284db/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:18.306121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:18.307541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.310822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207792e-6713-4444-8a53-59dc58665726 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.311107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207792e-6713-4444-8a53-59dc58665726 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.311378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207792e-6713-4444-8a53-59dc58665726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.327002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:18.360616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6207792e-6713-4444-8a53-59dc58665726 None None] MFA Rules not processed for user `497b2364a4754149aa499c61843284db`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:18.362506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6207792e-6713-4444-8a53-59dc58665726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.388973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1136/2291] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:18.393434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.407164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c1396-7d0f-4b74-988d-c4577818f37a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.413654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.414431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.414778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.415176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.415834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:18.416171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.417787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.430363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1137/2292] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:21:18.434821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.450049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5eb5e-efc2-4831-ba01-344c2c9483e6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.450228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1156/2293] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:18.454988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.455633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.456158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.456434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.457996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.458993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207792e-6713-4444-8a53-59dc58665726 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.460382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6207792e-6713-4444-8a53-59dc58665726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:18.460794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.518166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207792e-6713-4444-8a53-59dc58665726 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.521755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.522358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.522631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.522897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.531746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.533206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.542669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1157/2294] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:18.586305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1138/2295] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:18.590724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.601405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4df93f-1711-4128-9241-8c94f6738e1a service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.659138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.659758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.660032 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.660369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.661570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.666443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.818311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1158/2296] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:18 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:18.822998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.833957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cca7d-b963-476b-a5d1-023316ab7eb9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.838480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.839078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.839384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.839648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.840331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.841923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.854713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1139/2297] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:18.855766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.866146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935d11b-f4a6-4137-b719-d077ece3a352 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.872157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174a5c-af25-4668-94fd-ef40df653c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.872795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174a5c-af25-4668-94fd-ef40df653c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.873070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174a5c-af25-4668-94fd-ef40df653c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.873339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174a5c-af25-4668-94fd-ef40df653c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.873979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c174a5c-af25-4668-94fd-ef40df653c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.875570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c174a5c-af25-4668-94fd-ef40df653c37 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:18.886219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1159/2298] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:18.890557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:18.900397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548802a0-993f-4c70-be53-cfeb2284bf58 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:18.904830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:18.931411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:18.931411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:18.931411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] PATH_INFO: `/v3/projects/6c4e4bce8b4f406eaa90d2cfd0ae6cde/users/53381c3f06c04e61b4c543f824e87208/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:18.931411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4e4bce8b4f406eaa90d2cfd0ae6cde, user_id=53381c3f06c04e61b4c543f824e87208, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:18.931411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.000599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:19.010191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1140/2299] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:18 2022] PUT /identity/v3/projects/6c4e4bce8b4f406eaa90d2cfd0ae6cde/users/53381c3f06c04e61b4c543f824e87208/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:19.022500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.022789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.023071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.082835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] MFA Rules not processed for user `53381c3f06c04e61b4c543f824e87208`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:19.084153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:19.180220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1160/2300] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:19.194160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.196474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:19.302764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46620ce-fa7d-4162-af60-a9dde7c7891e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.307708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbdc19-b8ba-4b4b-8cd0-8b358c70e37d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.308639 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbdc19-b8ba-4b4b-8cd0-8b358c70e37d service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.308854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbdc19-b8ba-4b4b-8cd0-8b358c70e37d service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.309163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbdc19-b8ba-4b4b-8cd0-8b358c70e37d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.320371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbdc19-b8ba-4b4b-8cd0-8b358c70e37d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.321917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbdc19-b8ba-4b4b-8cd0-8b358c70e37d service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:19.331878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1141/2301] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:19.833572 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:19.896788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f27a2-53ab-4337-bc2c-99af827f2b60 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:19.901314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:19.901936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:19.902213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:19.902484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] PATH_INFO: `/v3/users/f20b24dc26174b41b3b2cf2f028dc38e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:19.903641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20b24dc26174b41b3b2cf2f028dc38e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:19.905593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:20.111327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20b24dc26174b41b3b2cf2f028dc38e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.111978 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20b24dc26174b41b3b2cf2f028dc38e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.119542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20b24dc26174b41b3b2cf2f028dc38e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.134443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20b24dc26174b41b3b2cf2f028dc38e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.135111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20b24dc26174b41b3b2cf2f028dc38e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:20.253449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:20.258356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1161/2302] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:19 2022] DELETE /identity/v3/users/f20b24dc26174b41b3b2cf2f028dc38e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:20.263134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:20.263561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:20.263678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:20.282854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:20.284402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:20.321957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:20.353992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1142/2303] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:20.366665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:20.368449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:20.431444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90d84f-2e00-459a-908c-67b40cd2429f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:20.435165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:20.435785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:20.436040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:20.436332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:20.446387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:20.447992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:20.458553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1162/2304] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:20.892479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:20.893926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:20.906645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16437837-b8db-45c8-800d-9a0b21fbaeef None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:20.913086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:20.917064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:20.917064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:20.917064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] PATH_INFO: `/v3/projects/c8af2eeec6e4401c9c71a1705a0f4cb2` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:20.917064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8af2eeec6e4401c9c71a1705a0f4cb2)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:20.918258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:21.074351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8af2eeec6e4401c9c71a1705a0f4cb2', 'request_id': 'req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.080507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8af2eeec6e4401c9c71a1705a0f4cb2', 'request_id': 'req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.086495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8af2eeec6e4401c9c71a1705a0f4cb2', 'request_id': 'req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.200254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] The token cache is being invalidate because project c8af2eeec6e4401c9c71a1705a0f4cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:21.200543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.201237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.202830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1143/2305] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:20 2022] DELETE /identity/v3/projects/c8af2eeec6e4401c9c71a1705a0f4cb2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:21.206797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:21.217315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9d85-3168-429e-8ed9-32723adc2230 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:21.274725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:21.275362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:21.275638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:21.275936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] PATH_INFO: `/v3/users/497b2364a4754149aa499c61843284db` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:21.277086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] RBAC: Authorizing `identity:delete_user(user_id=497b2364a4754149aa499c61843284db)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:21.278988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:21.548165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497b2364a4754149aa499c61843284db'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.548811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497b2364a4754149aa499c61843284db'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.557526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497b2364a4754149aa499c61843284db'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.572568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497b2364a4754149aa499c61843284db'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.575463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-46c35719-840a-475f-a75d-9ad829dc677d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497b2364a4754149aa499c61843284db'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:21.676844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1163/2306] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:21 2022] DELETE /identity/v3/users/497b2364a4754149aa499c61843284db => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:22.179083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:22.180908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:22.195763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4054e33-6e63-4bc1-a6a5-06f086d0f4e7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:22.266281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a426db3-3628-48da-973d-009362013541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:22.267031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426db3-3628-48da-973d-009362013541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:22.267381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426db3-3628-48da-973d-009362013541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:22.267719 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a426db3-3628-48da-973d-009362013541 admin admin] PATH_INFO: `/v3/projects/239f91377072484c8368a31c076a09cd` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:22.269012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426db3-3628-48da-973d-009362013541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239f91377072484c8368a31c076a09cd)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:22.271439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a426db3-3628-48da-973d-009362013541 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:22.401753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7a426db3-3628-48da-973d-009362013541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239f91377072484c8368a31c076a09cd', 'request_id': 'req-7a426db3-3628-48da-973d-009362013541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:22.416321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7a426db3-3628-48da-973d-009362013541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239f91377072484c8368a31c076a09cd', 'request_id': 'req-7a426db3-3628-48da-973d-009362013541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:22.416321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:22.416321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7a426db3-3628-48da-973d-009362013541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239f91377072484c8368a31c076a09cd', 'request_id': 'req-7a426db3-3628-48da-973d-009362013541'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:22.530990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7a426db3-3628-48da-973d-009362013541 admin admin] The token cache is being invalidate because project 239f91377072484c8368a31c076a09cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:22.531286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7a426db3-3628-48da-973d-009362013541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:22.532162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7a426db3-3628-48da-973d-009362013541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:22.537103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1144/2307] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:22 2022] DELETE /identity/v3/projects/239f91377072484c8368a31c076a09cd => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:22.539904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:22.540414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:22.540508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:22.574871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:22.576161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:22.595405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:22.659611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1164/2308] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:22.662241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:22.662522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:22.662815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:22.687617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:22.688860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:22.697774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1145/2309] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:22.702173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:22.712193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56417dbd-3544-4b75-869b-02dbf960d5e4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:22.717192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:22.717793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:22.718108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:22.718555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:22.719210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:22.719510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:22.721131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:22.733625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1165/2310] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:21:22.743885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:22.753525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8948507-3df6-42a5-a951-3939d8019302 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:22.759876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:22.760516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:22.760785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:22.761045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:22.761667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:22.763551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:22.889208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1146/2311] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:22 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:22.893429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:22.904028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2bcf6b-2d7f-4365-88ba-d82288d89044 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:22.965776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:22.966417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:22.967172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:22.967172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:22.967899 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:22.970253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:23.127370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1166/2312] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:22 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:23.131514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:23.142678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7aa6a6-dd17-4539-875c-b699685cab71 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:23.148474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:23.149918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:23.150187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:23.150456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:23.151103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:23.153054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:23.165293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1147/2313] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:23.169330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:23.180554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fd86a-56b3-47fa-807c-aa674edef5fd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:23.185442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8c859-6c82-4c51-8b4c-b962d7997d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:23.186207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c859-6c82-4c51-8b4c-b962d7997d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:23.187728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c859-6c82-4c51-8b4c-b962d7997d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:23.188020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8c859-6c82-4c51-8b4c-b962d7997d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:23.195066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c859-6c82-4c51-8b4c-b962d7997d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:23.195066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8c859-6c82-4c51-8b4c-b962d7997d43 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:23.201852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1167/2314] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:23.205910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:23.216857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e71b9-36cd-4b0e-8acd-84f5388e13c7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:23.221644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:23.222703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:23.241421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:23.241421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] PATH_INFO: `/v3/projects/19d829edef244431809f4ff8fff6b98d/users/df052b6b09e3410db63c09f5d142b592/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:23.242861 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d829edef244431809f4ff8fff6b98d, user_id=df052b6b09e3410db63c09f5d142b592, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:23.246232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:23.371547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1148/2315] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:23 2022] PUT /identity/v3/projects/19d829edef244431809f4ff8fff6b98d/users/df052b6b09e3410db63c09f5d142b592/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:23.383475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:23.383690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:23.383962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:23.456728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] MFA Rules not processed for user `df052b6b09e3410db63c09f5d142b592`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:23.457792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:23.600522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1168/2316] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:23.623411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:23.625227 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:23.712181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee275685-7a8e-4f94-8d83-98bbcebb89d0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:23.715844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:23.716492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:23.716770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:23.717045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:23.729407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:23.729407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:23.754911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1149/2317] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:26.874686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:26.876346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:26.903076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:26.957230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d442b-3b87-4761-b989-a6296c0acb8f None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:26.962400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:26.963312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:26.963583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:26.963846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] PATH_INFO: `/v3/users/6b36506349dd466ba0ac0b9949363dca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:26.965176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b36506349dd466ba0ac0b9949363dca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:26.967517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:27.163992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b36506349dd466ba0ac0b9949363dca'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.164919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b36506349dd466ba0ac0b9949363dca'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.172029 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b36506349dd466ba0ac0b9949363dca'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.184147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b36506349dd466ba0ac0b9949363dca'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.184798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b36506349dd466ba0ac0b9949363dca'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.286716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1169/2318] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:26 2022] DELETE /identity/v3/users/6b36506349dd466ba0ac0b9949363dca => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:27.533512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:27.557680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3aa9a-ac0f-449d-b9ec-fabdb6285276 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:27.617342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:27.618023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:27.618328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:27.618596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] PATH_INFO: `/v3/projects/738fb5cf8731481686d43596a3b64fe5` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:27.619735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=738fb5cf8731481686d43596a3b64fe5)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:27.621658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:27.730342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:27.743295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738fb5cf8731481686d43596a3b64fe5', 'request_id': 'req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.749569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738fb5cf8731481686d43596a3b64fe5', 'request_id': 'req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.755030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738fb5cf8731481686d43596a3b64fe5', 'request_id': 'req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.873519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] The token cache is being invalidate because project 738fb5cf8731481686d43596a3b64fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:27.873802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.874412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:27.875898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1150/2319] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:27 2022] DELETE /identity/v3/projects/738fb5cf8731481686d43596a3b64fe5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:27.880042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:27.881590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:27.895101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31a4bc-f28b-411e-a216-745ea59c7dd8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:27.960127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:27.960764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:27.961038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:27.961305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] PATH_INFO: `/v3/users/6f70a011f41248bb924a74a7144abebf` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:27.962412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f70a011f41248bb924a74a7144abebf)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:27.964433 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:28.015901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:28.017335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:28.029901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd3bc3-451c-4cb0-9ea7-02700f895ff8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:28.034638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:28.035232 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:28.042822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:28.042822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] PATH_INFO: `/v3/users/df052b6b09e3410db63c09f5d142b592` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:28.042822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=df052b6b09e3410db63c09f5d142b592)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:28.042822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:28.162713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:28.168428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f70a011f41248bb924a74a7144abebf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.169174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f70a011f41248bb924a74a7144abebf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.176238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f70a011f41248bb924a74a7144abebf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.190197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f70a011f41248bb924a74a7144abebf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.191673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a258e80c-5fae-482b-b51d-10629ba65568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f70a011f41248bb924a74a7144abebf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.318421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df052b6b09e3410db63c09f5d142b592'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.319671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df052b6b09e3410db63c09f5d142b592'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.320355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df052b6b09e3410db63c09f5d142b592'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.326212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1170/2320] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:27 2022] DELETE /identity/v3/users/6f70a011f41248bb924a74a7144abebf => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:28.329328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df052b6b09e3410db63c09f5d142b592'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.342694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df052b6b09e3410db63c09f5d142b592'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:28.656951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1151/2321] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:28 2022] DELETE /identity/v3/users/df052b6b09e3410db63c09f5d142b592 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:28.957940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:28.957940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:28.957940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:28.970500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:28.971715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:29.001835 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:29.003548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:29.041693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1171/2322] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:29.050315 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:29.054958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:29.090959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c16302-ba47-477f-a06f-be1831d542bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:29.095644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:29.096339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.096618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.096888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] PATH_INFO: `/v3/projects/224e9fe5d3f64a25b0086190310c02ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.098283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=224e9fe5d3f64a25b0086190310c02ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:29.100533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:29.112775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf86b3-03bc-46cf-bd37-7d5136cc9d06 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:29.116480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83b981-f1f4-41c8-892f-f802c901dfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:29.117093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b981-f1f4-41c8-892f-f802c901dfae service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.117369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b981-f1f4-41c8-892f-f802c901dfae service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.117640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83b981-f1f4-41c8-892f-f802c901dfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.127438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83b981-f1f4-41c8-892f-f802c901dfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:29.129493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83b981-f1f4-41c8-892f-f802c901dfae service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:29.139336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1172/2323] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:29.308789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:29.321056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224e9fe5d3f64a25b0086190310c02ca', 'request_id': 'req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.327319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224e9fe5d3f64a25b0086190310c02ca', 'request_id': 'req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.333176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224e9fe5d3f64a25b0086190310c02ca', 'request_id': 'req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.395164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] The token cache is being invalidate because project 224e9fe5d3f64a25b0086190310c02ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:29.395456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.396160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-de5b8573-91e3-4b15-ae9e-02ba3ee8b81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.397879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1152/2324] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:29 2022] DELETE /identity/v3/projects/224e9fe5d3f64a25b0086190310c02ca => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:29.403529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.403910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.404059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.425267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:29.426539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:29.488780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:29.499044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1173/2325] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:29.524468 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.525099 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.525568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.552940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:29.554137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:29.562021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1153/2326] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:29.566154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:29.575982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88cbe-3df9-403a-afec-0a61841094bc None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:29.580894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:29.581512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.581794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.582093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.582766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:29.583079 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:29.584905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:29.600275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1174/2327] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:21:29.604711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:29.614091 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94da8-3805-435f-a3a6-8a26ecdfb1ec None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:29.619364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:29.620242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.620591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.620875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.621511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:29.623502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:29.728226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:29.730197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:29.743669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef7d8b-a27f-4860-881c-17fc459b98f8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:29.748425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:29.766559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.766559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.766559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] PATH_INFO: `/v3/projects/19d829edef244431809f4ff8fff6b98d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.766559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d829edef244431809f4ff8fff6b98d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:29.766559 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:29.841809 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1154/2328] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:29 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:29.845947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:29.914456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d829edef244431809f4ff8fff6b98d', 'request_id': 'req-4365a7bd-4790-4173-aa0d-ce1a4c77010a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.921313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d829edef244431809f4ff8fff6b98d', 'request_id': 'req-4365a7bd-4790-4173-aa0d-ce1a4c77010a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.927257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d829edef244431809f4ff8fff6b98d', 'request_id': 'req-4365a7bd-4790-4173-aa0d-ce1a4c77010a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:29.928984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601b743-4e57-4212-b9af-2bc92c392548 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:29.989410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:29.990042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:29.990323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:29.990588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:29.991209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:29.993163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.039916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] The token cache is being invalidate because project 19d829edef244431809f4ff8fff6b98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:30.040521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:30.040944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4365a7bd-4790-4173-aa0d-ce1a4c77010a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:30.042548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1175/2329] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:29 2022] DELETE /identity/v3/projects/19d829edef244431809f4ff8fff6b98d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:30.047281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633ade-9573-4f58-8a0c-79f604f278ae None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.047575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633ade-9573-4f58-8a0c-79f604f278ae None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.047851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0633ade-9573-4f58-8a0c-79f604f278ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.068623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d0633ade-9573-4f58-8a0c-79f604f278ae None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:30.069906 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d0633ade-9573-4f58-8a0c-79f604f278ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:30.078735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1176/2330] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:30.088862 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.089252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.089627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.109144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:30.111561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:30.118406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1177/2331] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:30.122314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.131443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f2020-9eae-489c-b497-66d040b5b958 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.136189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.141974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.141974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.141974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.142259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1155/2332] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:29 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:21:30.142347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:30.142347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.142347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.142964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.144571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:30.154773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1178/2333] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:21:30.155743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.156706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31965d8a-4db0-4e44-aaed-0130236ca2a2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.162082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.162699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.162974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.163233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.163975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.166460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff758054-5ea6-4955-bb4c-a040089c322f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.171740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.172321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.172595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.172872 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.174086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.174208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.175532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.185870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1156/2334] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:30.189735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.199702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545ef7-8565-4fb7-af38-cfeebe7767dd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.204379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.204961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.205238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.205510 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.206144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.207965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.218802 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1157/2335] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:30.222930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.232939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6e02-218a-45a1-872d-58a3fa4bf22b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.237569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5c732-8f4b-47b2-a926-f781cf810d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.238180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5c732-8f4b-47b2-a926-f781cf810d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.238456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5c732-8f4b-47b2-a926-f781cf810d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.238727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5c732-8f4b-47b2-a926-f781cf810d69 admin admin] PATH_INFO: `/v3/projects/097a1b0b5bc346fcab2738bbbf30a8bd/users/519d8ed854344ff48f9c093bd1f0b1a1/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.254512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5c732-8f4b-47b2-a926-f781cf810d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=097a1b0b5bc346fcab2738bbbf30a8bd, user_id=519d8ed854344ff48f9c093bd1f0b1a1, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.257166 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5c732-8f4b-47b2-a926-f781cf810d69 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.281255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1179/2336] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:21:30.285242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.346892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a228fd-770b-46f4-8aba-031db1b9ca20 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.352095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.352718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.359878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.359878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.359878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.359878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.360279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1158/2337] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:30 2022] PUT /identity/v3/projects/097a1b0b5bc346fcab2738bbbf30a8bd/users/519d8ed854344ff48f9c093bd1f0b1a1/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:30.370571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.370879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.371209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.399787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] MFA Rules not processed for user `519d8ed854344ff48f9c093bd1f0b1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:30.399787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:30.460445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1180/2338] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:21:30.464258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.470249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1159/2339] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:21:30.477279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e36d-0851-408e-8368-5dafb7c2fc0d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.483742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.559041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06c6ec-e396-4836-82ec-1c7d8720673d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.566181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.566181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.566181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.566181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.566648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.566648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.568819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.570009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.570377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.570720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.571798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.575982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.577659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1181/2340] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:30.581931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.593037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122c561-d3e9-42aa-a5bf-b40ada4dbbfa admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.610598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.610598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.610598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.610598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.610982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.610982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.620749 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1182/2341] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:30.625107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.635403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44bdb9-7d6e-4c58-b8fc-630b02d83062 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.640045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c30161-82fe-4d30-9d2d-00cad6ee7649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.640701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c30161-82fe-4d30-9d2d-00cad6ee7649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.640975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c30161-82fe-4d30-9d2d-00cad6ee7649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.641245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c30161-82fe-4d30-9d2d-00cad6ee7649 admin admin] PATH_INFO: `/v3/projects/5489953069d1423ebd36e959ceaa317c/users/4d7191afba9744daa24d87c80732163a/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.657928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c30161-82fe-4d30-9d2d-00cad6ee7649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5489953069d1423ebd36e959ceaa317c, user_id=4d7191afba9744daa24d87c80732163a, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.660656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c30161-82fe-4d30-9d2d-00cad6ee7649 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.706114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1160/2342] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:30.707565 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.714785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:30.772865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44240-82c4-42be-b917-f0328ce26fb6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.779374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1183/2343] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:30 2022] PUT /identity/v3/projects/5489953069d1423ebd36e959ceaa317c/users/4d7191afba9744daa24d87c80732163a/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:30.784613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.784913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.785185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.805081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:30.812636 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:30.836740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.837351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.837633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.837897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.838520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.840611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.867153 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1184/2344] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:30.877087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.878484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:30.911260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1161/2345] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:30 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:30.912896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.922595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8cab34-6f67-4017-8ebd-628113582449 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.927439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.928645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.933331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.933331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.933331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.933331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.934437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118f6a3-5f2e-4d52-bbd1-b607585b5d03 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.938152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.938755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.939031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.939303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.941872 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1162/2346] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:30.946681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.952276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.953712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.956429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e860f-628d-47bb-8f2b-db64f3bada23 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.961159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d1d25-4bf6-4de9-8fbd-9b9d77eb794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.961750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d1d25-4bf6-4de9-8fbd-9b9d77eb794c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:30.962109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d1d25-4bf6-4de9-8fbd-9b9d77eb794c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:30.962278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d1d25-4bf6-4de9-8fbd-9b9d77eb794c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:30.962911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d1d25-4bf6-4de9-8fbd-9b9d77eb794c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:30.963910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1185/2347] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:30.964529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d1d25-4bf6-4de9-8fbd-9b9d77eb794c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:30.979668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1163/2348] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:30.983729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:30.994087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454df3-85b8-4442-b6b0-579d8f687698 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:30.999130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:30.999779 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.000053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.000355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] PATH_INFO: `/v3/projects/763f8071b32f4c72836f22bef50db43b/users/1515f61a95fc4a4d8f86954ee739a4b6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.010607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:31.016487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=763f8071b32f4c72836f22bef50db43b, user_id=1515f61a95fc4a4d8f86954ee739a4b6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.019121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.096515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1186/2349] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:30 2022] PUT /identity/v3/projects/763f8071b32f4c72836f22bef50db43b/users/1515f61a95fc4a4d8f86954ee739a4b6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:31.107158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.107515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.107858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.136799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] MFA Rules not processed for user `1515f61a95fc4a4d8f86954ee739a4b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:31.138142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:31.205033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1164/2350] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:31.210435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:31.281411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddd1a9-ca1c-428f-8da2-2f57badbbc0e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:31.287331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:31.287942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.288354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.288623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.289262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.291471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.430376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1187/2351] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:31 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:31.434436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:31.446253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b9c17-f447-4ab3-a744-331b4910b0da None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:31.510561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:31.521574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.521574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.521574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.521574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.521574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.531473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:31.611619 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1165/2352] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:31 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:31.616829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:31.630913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ddf0f-1880-41d6-bf35-bc7b4924d896 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:31.635700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:31.636339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.636623 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.636944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.637592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.639468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.653960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1188/2353] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:31.658387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:31.670032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a46ab-e644-4c23-b3d1-eb7217dcbdbc admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:31.674967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:31.675680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.679015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.679364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] PATH_INFO: `/v3/projects/9e8a9d3c07f541618a4e1cfb9657f3ce/users/a6ef1683ea214c4e887372192fdddd9a/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.700940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8a9d3c07f541618a4e1cfb9657f3ce, user_id=a6ef1683ea214c4e887372192fdddd9a, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.703623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.719807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:31.822648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1166/2354] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:31 2022] PUT /identity/v3/projects/9e8a9d3c07f541618a4e1cfb9657f3ce/users/a6ef1683ea214c4e887372192fdddd9a/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:31.826947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:31.838068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0184f61-415f-43f0-84af-a9bf8c1c8b38 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:31.902689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1605ce7-70ba-4c6e-b167-480cefab875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:31.903311 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1605ce7-70ba-4c6e-b167-480cefab875d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.903586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1605ce7-70ba-4c6e-b167-480cefab875d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.903859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1605ce7-70ba-4c6e-b167-480cefab875d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.904672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1605ce7-70ba-4c6e-b167-480cefab875d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.906318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1605ce7-70ba-4c6e-b167-480cefab875d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.924458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1189/2355] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:31.929038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:31.939446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c486b2-ea38-4b3b-9aee-dbf4319f7300 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:31.944319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:31.944902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.945231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.945502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] PATH_INFO: `/v3/projects/9e8a9d3c07f541618a4e1cfb9657f3ce/users/a6ef1683ea214c4e887372192fdddd9a/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:31.947391 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8a9d3c07f541618a4e1cfb9657f3ce, user_id=a6ef1683ea214c4e887372192fdddd9a, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:31.950050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:31.960970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1167/2356] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:31 2022] PUT /identity/v3/projects/9e8a9d3c07f541618a4e1cfb9657f3ce/users/a6ef1683ea214c4e887372192fdddd9a/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:31.971955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:31.972265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:31.972560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:32.005246 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] MFA Rules not processed for user `a6ef1683ea214c4e887372192fdddd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:32.006483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:32.079464 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1190/2357] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:32.080385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:32.095126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:32.096848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:32.154866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347332d-5b80-4702-870c-f53a319fa713 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:32.159615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ced8a06-3390-467d-a786-2543d6412703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:32.160264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8a06-3390-467d-a786-2543d6412703 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:32.160547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8a06-3390-467d-a786-2543d6412703 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:32.160812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced8a06-3390-467d-a786-2543d6412703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:32.217642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced8a06-3390-467d-a786-2543d6412703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:32.219300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ced8a06-3390-467d-a786-2543d6412703 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:32.232236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1168/2358] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:32.245649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:35.571829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:35.573448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:35.590342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafaed1-e713-4946-a4ef-62298ee25a1e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:35.598122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc233b45-b603-44a8-81fb-9a57c5ddfc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:35.599962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc233b45-b603-44a8-81fb-9a57c5ddfc27 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:35.600449 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc233b45-b603-44a8-81fb-9a57c5ddfc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:35.602865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc233b45-b603-44a8-81fb-9a57c5ddfc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:35.704140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc233b45-b603-44a8-81fb-9a57c5ddfc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:35.705603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc233b45-b603-44a8-81fb-9a57c5ddfc27 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:35.725102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1191/2359] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:35.837396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:35.838434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:35.838706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:35.858140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] MFA Rules not processed for user `438568aef00b421da7419f77a2fd7180`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:35.859351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:35.931316 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1169/2360] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:37.102415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:37.102861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:37.103208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:37.150656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] MFA Rules not processed for user `4d7191afba9744daa24d87c80732163a`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:37.164500 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:37.269203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1192/2361] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:37.273669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:37.288904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:37.367341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd1437-e2ca-41ed-9cce-ab83830deb4c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:37.377391 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:37.378213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:37.378706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:37.379726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:37.383403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:37.387413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:37.504410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1170/2362] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:37 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:37.507339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:37.521754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf9e14-56f6-4e5e-880b-79a3c1dd2b3a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:37.565832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:37.624980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:37.625713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:37.626110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:37.626381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:37.627060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:37.629172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:37.641366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ec7dc-cb05-465a-a978-a16ca3be1a4c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:37.648674 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:37.649489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:37.649770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:37.650044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:37.737511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1193/2363] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:37 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:37.738568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:37.745397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:37.749662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c246bfa-34ab-40c0-b4d4-f74b480c98db admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:37.757218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:37.757946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:37.758300 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:37.758641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:37.759921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:37.761349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:37.769577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:37.771774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:37.773854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1194/2364] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:37.782106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1171/2365] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:37.783730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:37.794381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8756e92-c0a9-4262-a758-e8345f408104 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:37.799790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:37.800522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:37.800802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:37.801143 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] PATH_INFO: `/v3/projects/dc6a71adc82d494e83ab54826ba104f7/users/5183095adb2f4f36958259ad3a969608/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:37.823627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6a71adc82d494e83ab54826ba104f7, user_id=5183095adb2f4f36958259ad3a969608, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:37.826732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:37.950813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1195/2366] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:37 2022] PUT /identity/v3/projects/dc6a71adc82d494e83ab54826ba104f7/users/5183095adb2f4f36958259ad3a969608/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:37.955261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:37.967574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7de59-5b2b-416e-9cc4-24e94bb7fd40 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:38.042354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:38.043152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:38.043575 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:38.043874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:38.044621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:38.046289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:38.062515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1172/2367] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:38.066170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:38.079529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3698d-b0d5-4128-aa5b-e4e314c26d3b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:38.087817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203fd52-46d9-40ab-9eeb-17489db9baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:38.089325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203fd52-46d9-40ab-9eeb-17489db9baf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:38.089923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203fd52-46d9-40ab-9eeb-17489db9baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:38.090346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203fd52-46d9-40ab-9eeb-17489db9baf8 admin admin] PATH_INFO: `/v3/projects/dc6a71adc82d494e83ab54826ba104f7/users/5183095adb2f4f36958259ad3a969608/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:38.092601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203fd52-46d9-40ab-9eeb-17489db9baf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6a71adc82d494e83ab54826ba104f7, user_id=5183095adb2f4f36958259ad3a969608, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:38.099676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203fd52-46d9-40ab-9eeb-17489db9baf8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:38.117383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1196/2368] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:38 2022] PUT /identity/v3/projects/dc6a71adc82d494e83ab54826ba104f7/users/5183095adb2f4f36958259ad3a969608/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:38.348164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:43.916059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:43.928692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9f6af-5ece-453f-ac69-7bd89802720c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:44.007098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:44.008287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:44.008796 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:44.009338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] PATH_INFO: `/v3/users/519d8ed854344ff48f9c093bd1f0b1a1` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:44.010967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519d8ed854344ff48f9c093bd1f0b1a1)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:44.013202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:44.216631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519d8ed854344ff48f9c093bd1f0b1a1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:44.217325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519d8ed854344ff48f9c093bd1f0b1a1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:44.218313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519d8ed854344ff48f9c093bd1f0b1a1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:44.226928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519d8ed854344ff48f9c093bd1f0b1a1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:44.241481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519d8ed854344ff48f9c093bd1f0b1a1'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:44.315188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1173/2369] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:43 2022] DELETE /identity/v3/users/519d8ed854344ff48f9c093bd1f0b1a1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:44.318071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:44.318579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:44.318579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:44.342455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:44.343671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:44.426954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1197/2370] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:44.439127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:44.440907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:44.531254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f790be0-4991-4dea-90b6-9699e023a357 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:44.536412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:44.537481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:44.538309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:44.538737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:44.549841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:44.553551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:44.564821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1174/2371] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:45.123929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:45.127081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:45.148163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd67b3-75ae-4f5d-9a36-cf536eb577a9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:45.153018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:45.153793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:45.154162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:45.154529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] PATH_INFO: `/v3/projects/097a1b0b5bc346fcab2738bbbf30a8bd` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:45.156210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=097a1b0b5bc346fcab2738bbbf30a8bd)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:45.158477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:45.305177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '097a1b0b5bc346fcab2738bbbf30a8bd', 'request_id': 'req-711b430f-2df4-45c9-8bdc-10feaff47a4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.325429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '097a1b0b5bc346fcab2738bbbf30a8bd', 'request_id': 'req-711b430f-2df4-45c9-8bdc-10feaff47a4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.345326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '097a1b0b5bc346fcab2738bbbf30a8bd', 'request_id': 'req-711b430f-2df4-45c9-8bdc-10feaff47a4d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.460729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] The token cache is being invalidate because project 097a1b0b5bc346fcab2738bbbf30a8bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:45.460729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.460729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-711b430f-2df4-45c9-8bdc-10feaff47a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.460729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1198/2372] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:45 2022] DELETE /identity/v3/projects/097a1b0b5bc346fcab2738bbbf30a8bd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:45.463369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:45.476074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492cd419-b5c9-45d9-b1a5-b6f934882605 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:45.480838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:45.583300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:45.583945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:45.584283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:45.584554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] PATH_INFO: `/v3/users/1515f61a95fc4a4d8f86954ee739a4b6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:45.585683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1515f61a95fc4a4d8f86954ee739a4b6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:45.588235 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:45.830635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1515f61a95fc4a4d8f86954ee739a4b6'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.831332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1515f61a95fc4a4d8f86954ee739a4b6'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.831960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1515f61a95fc4a4d8f86954ee739a4b6'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.840246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1515f61a95fc4a4d8f86954ee739a4b6'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.857793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1515f61a95fc4a4d8f86954ee739a4b6'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:45.990665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1175/2373] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:45 2022] DELETE /identity/v3/users/1515f61a95fc4a4d8f86954ee739a4b6 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:46.391043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:46.391895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:46.392453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:46.428061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] MFA Rules not processed for user `5183095adb2f4f36958259ad3a969608`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:46.429581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:46.460174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:46.497753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:46.499778 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:46.507393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1199/2374] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:46.526946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:46.529243 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:46.587022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f8912-c8b8-430a-9418-5ee46138ce14 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:46.592319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:46.593008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:46.593287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:46.593597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] PATH_INFO: `/v3/projects/763f8071b32f4c72836f22bef50db43b` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:46.594934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763f8071b32f4c72836f22bef50db43b)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:46.597008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f0b30-c6b0-45d0-b4d1-b2cf46f7cfb9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:46.597465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:46.601645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:46.602249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:46.602517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:46.602792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:46.605446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:46.667990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:46.669541 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:46.679169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1200/2375] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:21:46.755764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:46.770561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763f8071b32f4c72836f22bef50db43b', 'request_id': 'req-fbadf07b-3329-4fe1-8419-36f98bd02483'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:46.776759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763f8071b32f4c72836f22bef50db43b', 'request_id': 'req-fbadf07b-3329-4fe1-8419-36f98bd02483'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:46.782934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763f8071b32f4c72836f22bef50db43b', 'request_id': 'req-fbadf07b-3329-4fe1-8419-36f98bd02483'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:46.941291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] The token cache is being invalidate because project 763f8071b32f4c72836f22bef50db43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:46.941711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:46.942379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fbadf07b-3329-4fe1-8419-36f98bd02483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:46.943902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1176/2376] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:46 2022] DELETE /identity/v3/projects/763f8071b32f4c72836f22bef50db43b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:46.948128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:46.959797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687287c-d174-4833-b8e3-d2e110c9023d service glance] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:47.016115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:47.016656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:47.016929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:47.023387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:47.024055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:47.024354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:47.024619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] PATH_INFO: `/v3/users/a6ef1683ea214c4e887372192fdddd9a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:47.025781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ef1683ea214c4e887372192fdddd9a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:47.027649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:47.040500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:47.041611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:47.053748 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:47.131923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1177/2377] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:21:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:47.181382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:47.182859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:47.275626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dcc3b-d5c7-4132-9193-a838ddf886e9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:47.282114 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:47.282836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:47.283153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:47.283552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:47.294934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:47.296650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:47.305406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ef1683ea214c4e887372192fdddd9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:47.306808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ef1683ea214c4e887372192fdddd9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:47.309622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1178/2378] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:21:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:21:47.354764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ef1683ea214c4e887372192fdddd9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:47.390767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ef1683ea214c4e887372192fdddd9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:47.391897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fde1eedb-6aac-454d-aef0-e8b864d9c80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ef1683ea214c4e887372192fdddd9a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:47.473637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1201/2379] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:21:46 2022] DELETE /identity/v3/users/a6ef1683ea214c4e887372192fdddd9a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:48.198253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:48.203210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:48.245021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c7330-ded9-4340-8d57-178642fcb8da service swift] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:48.358355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:48.372833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:48.373699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:48.374151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:48.374807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] PATH_INFO: `/v3/projects/9e8a9d3c07f541618a4e1cfb9657f3ce` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:48.377170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8a9d3c07f541618a4e1cfb9657f3ce)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:48.379844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:48.542533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8a9d3c07f541618a4e1cfb9657f3ce', 'request_id': 'req-c98fdef8-584a-405a-87a1-9abbf65e7eda'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:48.562616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8a9d3c07f541618a4e1cfb9657f3ce', 'request_id': 'req-c98fdef8-584a-405a-87a1-9abbf65e7eda'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:48.580519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8a9d3c07f541618a4e1cfb9657f3ce', 'request_id': 'req-c98fdef8-584a-405a-87a1-9abbf65e7eda'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:48.692968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] The token cache is being invalidate because project 9e8a9d3c07f541618a4e1cfb9657f3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:21:48.693327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:48.694164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c98fdef8-584a-405a-87a1-9abbf65e7eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:21:48.695767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1179/2380] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:21:48 2022] DELETE /identity/v3/projects/9e8a9d3c07f541618a4e1cfb9657f3ce => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:48.700927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:48.701893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:48.702230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:48.748860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:48.752268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:48.849925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1202/2381] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:48.863440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:48.864286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:48.864648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:48.891870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:48.893548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:48.911150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:48.911936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1180/2382] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:48.922959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ca0e6-e73e-4276-87c5-a82e6d93406a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:48.938348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:48.939230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:48.939611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:48.939988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:48.940782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:21:48.941181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:48.942998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:48.974668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1203/2383] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:21:48.979236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:48.994001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbede343-67c8-4541-90b4-6db61e3b46e9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:49.005525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:49.006183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.006465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.006748 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.007376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:49.009374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:49.107883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1181/2384] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:48 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:49.109155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:49.128657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ed8a4-93da-4ab0-9585-2030c6b7237a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:49.232106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:49.232322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.232668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.233599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.233793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:49.236036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:49.326274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1204/2385] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:49 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:49.330570 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:49.352997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5a47e-cf3c-4d49-9620-313e607829fb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:49.359222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:49.364247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.364247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.364247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.364247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:49.364247 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:49.375368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1182/2386] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:49.380067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:49.399088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e002ccd0-fec0-43b3-a00b-caf86a936b04 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:49.405594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b08c79-78a6-4a67-90ab-551488d84b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:49.406365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b08c79-78a6-4a67-90ab-551488d84b8c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.406741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b08c79-78a6-4a67-90ab-551488d84b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.407708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b08c79-78a6-4a67-90ab-551488d84b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.408679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b08c79-78a6-4a67-90ab-551488d84b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:49.411609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b08c79-78a6-4a67-90ab-551488d84b8c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:49.442326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:49.450055 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1205/2387] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:49.455012 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6fa2b-bda1-4d17-bcc1-cc76cfb5a1e4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:49.463124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:49.464352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.465444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.465890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] PATH_INFO: `/v3/projects/2337e86ba39740379e006dc2e34b2b16/users/16337a9781794a168ab53a8e50e1f5bf/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.487587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2337e86ba39740379e006dc2e34b2b16, user_id=16337a9781794a168ab53a8e50e1f5bf, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:49.491525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:49.579956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1183/2388] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:49 2022] PUT /identity/v3/projects/2337e86ba39740379e006dc2e34b2b16/users/16337a9781794a168ab53a8e50e1f5bf/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:49.582367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.582701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.583166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.595953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:49.635992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] MFA Rules not processed for user `16337a9781794a168ab53a8e50e1f5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:49.647041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:49.757237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1206/2389] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:49.758384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:49.890913 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaf42e-abb1-4dbe-8e86-315030de8b49 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:49.896514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:49.899774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:49.899774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:49.899774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:49.899774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:49.900688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:50.026329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1184/2390] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:49 2022] POST /identity/v3/projects => generated 383 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:50.026795 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:50.042775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ced9c-b4bc-49ea-acec-8b26a774fd61 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:50.157760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:50.159495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:50.159976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:50.161244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:50.162104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:50.165669 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:50.285892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1207/2391] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:50 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:50.290501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:50.302895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:50.315421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3664482-edb3-43ff-a8e8-3420dfdcf321 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:50.322734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:50.323364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:50.323641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:50.323910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:50.327972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:50.339513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:50.374490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1185/2392] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:50.383584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:50.397610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2af9-52ec-42ff-988f-08026187c8b4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:50.417133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824b5f3-f7c3-4309-8acc-3178cb346389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:50.417777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824b5f3-f7c3-4309-8acc-3178cb346389 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:50.418053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824b5f3-f7c3-4309-8acc-3178cb346389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:50.418322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824b5f3-f7c3-4309-8acc-3178cb346389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:50.420150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824b5f3-f7c3-4309-8acc-3178cb346389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:50.422983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824b5f3-f7c3-4309-8acc-3178cb346389 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:50.439801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1208/2393] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:50.445110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:50.461636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc530-f703-4d30-899d-9a6127289543 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:50.469027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:50.469711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:50.470202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:50.470476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] PATH_INFO: `/v3/projects/cd3a2baa7cb049fcb5bd3ab9c9957262/users/64479b489a74448682d2fbb507e4825b/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:50.491577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3a2baa7cb049fcb5bd3ab9c9957262, user_id=64479b489a74448682d2fbb507e4825b, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:50.498737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:50.593547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1186/2394] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:50 2022] PUT /identity/v3/projects/cd3a2baa7cb049fcb5bd3ab9c9957262/users/64479b489a74448682d2fbb507e4825b/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:50.595832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:50.603394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:50.608671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:50.678455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] MFA Rules not processed for user `64479b489a74448682d2fbb507e4825b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:50.679847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:50.770456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1209/2395] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:50.775239 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:50.921962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934d40a-0a7b-4ba5-aba1-350fca732524 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:50.932332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:50.933433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:50.933934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:50.934374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:50.935395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:50.940818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:51.491406 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1187/2396] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:21:50 2022] POST /identity/v3/projects => generated 383 bytes in 717 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:21:51.492796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:51.509931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:51.517519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759204c-9539-47e8-88ec-12b34ea62fb0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:51.623980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:51.624712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:51.625007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:51.625256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:51.625894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:51.627973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:51.704138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1210/2397] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:21:51 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:21:51.707388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:51.721727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff09bd-37b3-4df0-a21c-8960ca68cf51 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:51.729043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:51.737003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:51.737003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:51.737003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:51.737003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:51.737003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:51.751171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1188/2398] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:21:51.755534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:51.773146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61722989-a9bd-4824-9ae1-b52cd6648fce admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:51.778382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:51.779095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:51.779374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:51.779714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] PATH_INFO: `/v3/projects/7dedf9fec55647f4b1ca0612a980b87a/users/57bcd7527b5d4b1a81668ecdd01f8f3a/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:51.801831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dedf9fec55647f4b1ca0612a980b87a, user_id=57bcd7527b5d4b1a81668ecdd01f8f3a, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:51.804989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:51.903525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1211/2399] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:51 2022] PUT /identity/v3/projects/7dedf9fec55647f4b1ca0612a980b87a/users/57bcd7527b5d4b1a81668ecdd01f8f3a/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:21:51.907764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:51.932241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a3bf2-7982-45e8-a71e-68b53ea6efc2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:52.033757 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf491e-c6e4-4158-9bef-57ab61ca2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:52.034389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf491e-c6e4-4158-9bef-57ab61ca2b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:52.034665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf491e-c6e4-4158-9bef-57ab61ca2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:52.034937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf491e-c6e4-4158-9bef-57ab61ca2b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:52.036388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf491e-c6e4-4158-9bef-57ab61ca2b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:52.038058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf491e-c6e4-4158-9bef-57ab61ca2b01 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:52.053693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1189/2400] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:21:52.054891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:52.067093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb0b6f-3a83-4b2d-a960-994f55b8fad0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:52.073322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:52.073322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:52.073322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:52.073630 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] PATH_INFO: `/v3/projects/7dedf9fec55647f4b1ca0612a980b87a/users/57bcd7527b5d4b1a81668ecdd01f8f3a/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:52.075571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dedf9fec55647f4b1ca0612a980b87a, user_id=57bcd7527b5d4b1a81668ecdd01f8f3a, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:52.078457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:52.091019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1212/2401] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:21:52 2022] PUT /identity/v3/projects/7dedf9fec55647f4b1ca0612a980b87a/users/57bcd7527b5d4b1a81668ecdd01f8f3a/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:21:52.102865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:52.103146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:52.103414 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:52.140287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] MFA Rules not processed for user `57bcd7527b5d4b1a81668ecdd01f8f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:52.141531 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:52.183456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:52.287378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1190/2402] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:21:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:52.297758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:52.304154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:52.451847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37b4b-3dd1-4db1-a54b-4ac69df8607e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:52.456019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b7df5-ab9e-4496-92f2-82994e916b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:52.456746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b7df5-ab9e-4496-92f2-82994e916b8c service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:52.457592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b7df5-ab9e-4496-92f2-82994e916b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:52.458092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b7df5-ab9e-4496-92f2-82994e916b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:52.560927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b7df5-ab9e-4496-92f2-82994e916b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:52.562616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b7df5-ab9e-4496-92f2-82994e916b8c service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:52.574712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1213/2403] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:55.889732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:55.891133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:55.904287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbe81-8427-4748-8408-6c31d0e1e082 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:55.907978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:55.908624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:55.908902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:55.909171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:55.999625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:56.001160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:56.015195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1191/2404] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:57.365127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:57.365643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:57.365643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:57.448016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:21:57.449330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:57.459151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:21:57.543239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1214/2405] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:21:57.569168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:57.572352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:21:57.681313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a4b60-6311-4122-a325-0e25b1260645 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:57.687023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217f78f-217a-4b66-a1a6-27b2487aa22b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:57.687774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217f78f-217a-4b66-a1a6-27b2487aa22b service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:57.688168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217f78f-217a-4b66-a1a6-27b2487aa22b service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:57.688451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217f78f-217a-4b66-a1a6-27b2487aa22b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:57.698036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217f78f-217a-4b66-a1a6-27b2487aa22b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:57.700041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217f78f-217a-4b66-a1a6-27b2487aa22b service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:57.713945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1192/2406] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:21:58.098273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:21:58.108810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82bc6a-954f-49ae-bf36-3c0751900624 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:21:58.115756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36e34e-0e21-4756-8aae-b35e884abb2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:21:58.116519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36e34e-0e21-4756-8aae-b35e884abb2f service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:21:58.116873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36e34e-0e21-4756-8aae-b35e884abb2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:21:58.117201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36e34e-0e21-4756-8aae-b35e884abb2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:21:58.126803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36e34e-0e21-4756-8aae-b35e884abb2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:21:58.128358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36e34e-0e21-4756-8aae-b35e884abb2f service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:21:58.140950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1215/2407] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:21:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:00.403519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:00.404109 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:00.404220 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:00.423661 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] MFA Rules not processed for user `4d7191afba9744daa24d87c80732163a`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:00.424978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:00.471056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:00.484981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1193/2408] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:03.952671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:03.953247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:03.953247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:03.974958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:03.976219 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:03.984624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1216/2409] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:04.011820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:04.013942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:04.030004 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0b18b-8946-4282-8a7c-6fbf7c834619 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:04.036106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ea9af-b85d-4479-af1c-b9efddff324d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:04.036695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea9af-b85d-4479-af1c-b9efddff324d service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:04.036964 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea9af-b85d-4479-af1c-b9efddff324d service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:04.037275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ea9af-b85d-4479-af1c-b9efddff324d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:04.045455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ea9af-b85d-4479-af1c-b9efddff324d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:04.049558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ea9af-b85d-4479-af1c-b9efddff324d service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:04.057233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1194/2410] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:22:04.187917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:04.197754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2895a95-c9e5-4602-9871-ac9f84b699eb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:04.202516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:04.203139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:04.203412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:04.203678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] PATH_INFO: `/v3/users/16337a9781794a168ab53a8e50e1f5bf` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:04.204837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16337a9781794a168ab53a8e50e1f5bf)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:04.206789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:04.438269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16337a9781794a168ab53a8e50e1f5bf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:04.439395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16337a9781794a168ab53a8e50e1f5bf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:04.446617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16337a9781794a168ab53a8e50e1f5bf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:04.459629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16337a9781794a168ab53a8e50e1f5bf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:04.460337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16337a9781794a168ab53a8e50e1f5bf'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:04.534939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1217/2411] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:22:04 2022] DELETE /identity/v3/users/16337a9781794a168ab53a8e50e1f5bf => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:04.540380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:04.540732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:04.541073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:04.560040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:04.561274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:04.620499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1195/2412] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:04.630896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:04.632314 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:04.690165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56df0ae-4e7f-449c-a6aa-b2d141566569 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:04.694247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:04.694882 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:04.695165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:04.695431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:04.704471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:04.705896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:04.717189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1218/2413] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:05.167670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:05.170349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:05.184963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64a8f8-1bfb-480c-bb40-758c28a1e2f4 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:05.189523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:05.190157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:05.190431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:05.190700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] PATH_INFO: `/v3/projects/2337e86ba39740379e006dc2e34b2b16` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:05.192439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2337e86ba39740379e006dc2e34b2b16)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:05.194341 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:05.296484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2337e86ba39740379e006dc2e34b2b16', 'request_id': 'req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.303276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2337e86ba39740379e006dc2e34b2b16', 'request_id': 'req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.309121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2337e86ba39740379e006dc2e34b2b16', 'request_id': 'req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.387979 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] The token cache is being invalidate because project 2337e86ba39740379e006dc2e34b2b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:22:05.388383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.389079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.393689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1196/2414] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:22:05 2022] DELETE /identity/v3/projects/2337e86ba39740379e006dc2e34b2b16 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:05.394935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:05.401015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:05.407344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a0ee-a63c-40d8-bbe1-1100a0df095f service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:05.475994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:05.477101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:05.477798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:05.478081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] PATH_INFO: `/v3/users/64479b489a74448682d2fbb507e4825b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:05.479250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64479b489a74448682d2fbb507e4825b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:05.481256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:05.665507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64479b489a74448682d2fbb507e4825b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.666570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64479b489a74448682d2fbb507e4825b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.681607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64479b489a74448682d2fbb507e4825b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.697570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64479b489a74448682d2fbb507e4825b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.698305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64479b489a74448682d2fbb507e4825b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:05.849575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1219/2415] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:22:05 2022] DELETE /identity/v3/users/64479b489a74448682d2fbb507e4825b => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:06.324323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:06.327426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:06.345169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3b56f-82ea-4f72-8f17-84fe0a02192b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:06.437613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:06.437613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:06.437613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:06.437613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] PATH_INFO: `/v3/projects/cd3a2baa7cb049fcb5bd3ab9c9957262` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:06.438135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3a2baa7cb049fcb5bd3ab9c9957262)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:06.438135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:06.438135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:06.529909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3a2baa7cb049fcb5bd3ab9c9957262', 'request_id': 'req-a7a14e17-ae5d-4751-bc1b-c8f28299f444'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.537329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3a2baa7cb049fcb5bd3ab9c9957262', 'request_id': 'req-a7a14e17-ae5d-4751-bc1b-c8f28299f444'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.543473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3a2baa7cb049fcb5bd3ab9c9957262', 'request_id': 'req-a7a14e17-ae5d-4751-bc1b-c8f28299f444'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.620640 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] The token cache is being invalidate because project cd3a2baa7cb049fcb5bd3ab9c9957262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:22:06.620855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.621481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a7a14e17-ae5d-4751-bc1b-c8f28299f444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.623006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1197/2416] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:22:06 2022] DELETE /identity/v3/projects/cd3a2baa7cb049fcb5bd3ab9c9957262 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:06.627180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:06.628627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:06.641250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edc37-7cbb-44c3-8e9f-7ecf153320d7 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:06.704053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:06.704652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:06.704925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:06.705192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] PATH_INFO: `/v3/users/57bcd7527b5d4b1a81668ecdd01f8f3a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:06.706326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bcd7527b5d4b1a81668ecdd01f8f3a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:06.709015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:06.827483 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:06.944429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bcd7527b5d4b1a81668ecdd01f8f3a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.945247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bcd7527b5d4b1a81668ecdd01f8f3a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.952428 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bcd7527b5d4b1a81668ecdd01f8f3a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.964759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bcd7527b5d4b1a81668ecdd01f8f3a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:06.965563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bcd7527b5d4b1a81668ecdd01f8f3a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:07.040041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1220/2417] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:22:06 2022] DELETE /identity/v3/users/57bcd7527b5d4b1a81668ecdd01f8f3a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:07.110106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:07.110410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:07.110685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:07.135683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:07.137495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:07.197641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1198/2418] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:22:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:07.210812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:07.212321 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:07.291394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d43a-5a75-4278-b05e-4fa025ae0f50 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:07.296773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d48aa1-8d9a-45bf-aa98-6c87f62071c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:07.297394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48aa1-8d9a-45bf-aa98-6c87f62071c4 service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:07.297672 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48aa1-8d9a-45bf-aa98-6c87f62071c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:07.297941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48aa1-8d9a-45bf-aa98-6c87f62071c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:07.307410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d48aa1-8d9a-45bf-aa98-6c87f62071c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:07.309037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d48aa1-8d9a-45bf-aa98-6c87f62071c4 service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:07.322181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1221/2419] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:22:07.644357 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:07.652684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:07.774550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d16f5-af2d-49b1-9789-d556a7a5f3ff None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:07.779999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:07.780925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:07.781393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:07.781993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] PATH_INFO: `/v3/projects/7dedf9fec55647f4b1ca0612a980b87a` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:07.783350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dedf9fec55647f4b1ca0612a980b87a)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:07.786434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:07.891730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:07.897667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dedf9fec55647f4b1ca0612a980b87a', 'request_id': 'req-4c151c08-3d6c-4483-918a-43952aeaa405'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:07.909164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dedf9fec55647f4b1ca0612a980b87a', 'request_id': 'req-4c151c08-3d6c-4483-918a-43952aeaa405'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:07.918254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dedf9fec55647f4b1ca0612a980b87a', 'request_id': 'req-4c151c08-3d6c-4483-918a-43952aeaa405'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:07.975846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] The token cache is being invalidate because project 7dedf9fec55647f4b1ca0612a980b87a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:22:07.976354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:07.977267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-4c151c08-3d6c-4483-918a-43952aeaa405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:07.982325 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1199/2420] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:22:07 2022] DELETE /identity/v3/projects/7dedf9fec55647f4b1ca0612a980b87a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:07.983769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:07.984234 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:07.984336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.032951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:08.034266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:08.134484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1222/2421] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:08.206291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.206704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.206895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.227430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:08.228754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:08.237017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1200/2422] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:08.241909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.275386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f08c8-5c96-4184-ba77-4322474424d3 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:08.286660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:08.287097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.287372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.287641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.288323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:22:08.288792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:08.290529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:08.303519 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1223/2423] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:22:08.308845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.318954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58b94-0cd9-4381-8950-bab3d606ba23 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:08.324426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:08.325382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.325846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.326380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.327198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:08.329679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:08.458474 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1201/2424] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:22:08 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:22:08.463565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.476706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55d0db-15be-497a-a861-693683fc963f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:08.500244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:08.549344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:08.549965 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.550245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.550567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.551204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:08.553814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:08.651111 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1224/2425] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:22:08 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:22:08.655799 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.667827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f30549-f578-457b-8267-9f1d5ff46339 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:08.672742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:08.673342 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.673611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.673874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.674508 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:08.676129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:08.687353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1202/2426] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:22:08.691503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.701986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f34b-82b1-4816-8524-96ba9e02671c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:08.709329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70ba6e-0290-46f3-b4ad-6d65ccfdb9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:08.709986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ba6e-0290-46f3-b4ad-6d65ccfdb9dc admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.710381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ba6e-0290-46f3-b4ad-6d65ccfdb9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.710668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70ba6e-0290-46f3-b4ad-6d65ccfdb9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.711165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70ba6e-0290-46f3-b4ad-6d65ccfdb9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:08.712811 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70ba6e-0290-46f3-b4ad-6d65ccfdb9dc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:08.725801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1225/2427] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:22:08.731514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.741420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2414cd2-1882-4e6f-9bd4-163008b63c49 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:08.746173 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:08.746822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.747092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.747357 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] PATH_INFO: `/v3/projects/2354c87caef24900a2e1b5276df7a6f0/users/8ff5d6212ea2438aabb3c47eb37eea78/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.765013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2354c87caef24900a2e1b5276df7a6f0, user_id=8ff5d6212ea2438aabb3c47eb37eea78, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:08.767749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:08.833585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1203/2428] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:22:08 2022] PUT /identity/v3/projects/2354c87caef24900a2e1b5276df7a6f0/users/8ff5d6212ea2438aabb3c47eb37eea78/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:08.844637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381057aa-6804-41fe-9c91-65cdfe0a3fb2 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:08.844637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381057aa-6804-41fe-9c91-65cdfe0a3fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:08.844637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381057aa-6804-41fe-9c91-65cdfe0a3fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:08.859302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-381057aa-6804-41fe-9c91-65cdfe0a3fb2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:08.860567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-381057aa-6804-41fe-9c91-65cdfe0a3fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:08.925229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1226/2429] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:08.936720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:08.938536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:09.013211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e976f4-2d8f-4d67-a49c-6811fadfded3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:09.017037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:09.017648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:09.017925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:09.018195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:09.028858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:09.030383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:09.043563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1204/2430] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:09.308497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793325-9c63-426c-8852-195bfa298076 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:09.309427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793325-9c63-426c-8852-195bfa298076 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:09.309701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95793325-9c63-426c-8852-195bfa298076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:09.332563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-95793325-9c63-426c-8852-195bfa298076 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:09.334026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95793325-9c63-426c-8852-195bfa298076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:09.342744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1227/2431] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:09.368188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:09.370435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:09.454481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:09.465060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712d59d-9b38-4eb2-9c04-e6849654619f service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:09.471394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe62fc0-d7de-41e1-b735-3562ec392583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:09.472490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62fc0-d7de-41e1-b735-3562ec392583 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:09.472767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62fc0-d7de-41e1-b735-3562ec392583 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:09.473040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62fc0-d7de-41e1-b735-3562ec392583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:09.490938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe62fc0-d7de-41e1-b735-3562ec392583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:09.492648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe62fc0-d7de-41e1-b735-3562ec392583 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:09.503042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1205/2432] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:12.279085 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95793325-9c63-426c-8852-195bfa298076 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:12.280671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-95793325-9c63-426c-8852-195bfa298076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:12.295360 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95793325-9c63-426c-8852-195bfa298076 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:12.304830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:12.305760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:12.306218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:12.306691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] PATH_INFO: `/v3/users/53381c3f06c04e61b4c543f824e87208` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:12.308431 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53381c3f06c04e61b4c543f824e87208)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:12.310584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:12.517863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53381c3f06c04e61b4c543f824e87208'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:12.520546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53381c3f06c04e61b4c543f824e87208'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:12.536722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53381c3f06c04e61b4c543f824e87208'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:12.566616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53381c3f06c04e61b4c543f824e87208'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:12.574892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53381c3f06c04e61b4c543f824e87208'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:12.678457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1228/2433] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:22:12 2022] DELETE /identity/v3/users/53381c3f06c04e61b4c543f824e87208 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:12.683178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:12.683700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:12.688409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:12.718894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:12.720260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:12.851693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1206/2434] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:12.862804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:12.864802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:12.878833 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:12.982160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471db403-7c21-4aa0-bf88-2639da3be872 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:12.987202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b172a-bf1e-475e-8697-b1f544f7772a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:12.988028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b172a-bf1e-475e-8697-b1f544f7772a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:12.988673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b172a-bf1e-475e-8697-b1f544f7772a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:12.989641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b172a-bf1e-475e-8697-b1f544f7772a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:13.001893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b172a-bf1e-475e-8697-b1f544f7772a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:13.003649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b172a-bf1e-475e-8697-b1f544f7772a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:13.027597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1229/2435] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:14.331994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:14.343814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:14.379803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce9ff-3abe-42e3-acf4-09fd02185262 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:14.415543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:14.418655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:14.420487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:14.420928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] PATH_INFO: `/v3/projects/6c4e4bce8b4f406eaa90d2cfd0ae6cde` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:14.423681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c4e4bce8b4f406eaa90d2cfd0ae6cde)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:14.433983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:14.649277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c4e4bce8b4f406eaa90d2cfd0ae6cde', 'request_id': 'req-9395016d-b95f-40d6-8bbe-7f7d960e41f2'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:14.657267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c4e4bce8b4f406eaa90d2cfd0ae6cde', 'request_id': 'req-9395016d-b95f-40d6-8bbe-7f7d960e41f2'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:14.666048 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c4e4bce8b4f406eaa90d2cfd0ae6cde', 'request_id': 'req-9395016d-b95f-40d6-8bbe-7f7d960e41f2'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:14.781248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] The token cache is being invalidate because project 6c4e4bce8b4f406eaa90d2cfd0ae6cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:22:14.781535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:14.782200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9395016d-b95f-40d6-8bbe-7f7d960e41f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:14.784138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1207/2436] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:22:14 2022] DELETE /identity/v3/projects/6c4e4bce8b4f406eaa90d2cfd0ae6cde => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:14.789620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:14.790202 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:14.790430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:14.820798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:14.822553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:14.942934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1230/2437] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:14.956053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:14.956548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:14.956825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:14.987870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:14.989745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:15.000135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1208/2438] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:15.004068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.014551 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575ed42-2a9f-4ecd-9460-3967eb26824b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:15.024943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:15.025812 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.026138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.026423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.027094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:22:15.027398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:15.029149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:15.064122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1231/2439] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:22:15.067273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.078845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98edde-c599-4f9c-bda4-f05f323d979a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:15.093364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:15.103948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.103948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.103948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.103948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:15.105968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:15.219291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1209/2440] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:22:15 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:22:15.220367 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.231389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acf54-0cba-4484-b7b5-cff78c1ecbd4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:15.358188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:15.359047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.359806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.360263 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.361195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:15.368304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:15.465119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1232/2441] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:22:15 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:22:15.471193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.490284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fb4ff-e478-42fd-8f8c-887562257e4e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:15.498960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:15.501125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.501398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.501668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.507469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:15.509628 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:15.536486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1210/2442] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:22:15.540136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.555434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45a65a-6176-4541-a351-f491094ba7a8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:15.562806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9657989-bc9e-4e31-860e-9d1e702ba5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:15.564313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657989-bc9e-4e31-860e-9d1e702ba5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.564446 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657989-bc9e-4e31-860e-9d1e702ba5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.564744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9657989-bc9e-4e31-860e-9d1e702ba5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.565594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9657989-bc9e-4e31-860e-9d1e702ba5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:15.568272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9657989-bc9e-4e31-860e-9d1e702ba5f2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:15.583898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1233/2443] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:22:15.587322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.606108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28de68-c49d-480b-ba20-0ef67bab5e95 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:15.611378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:15.612687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.613141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.613622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] PATH_INFO: `/v3/projects/4e6d862af1e642c18fe896d51870516b/users/bcb6998200e04d77a3eb020eb51d1132/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.631787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6d862af1e642c18fe896d51870516b, user_id=bcb6998200e04d77a3eb020eb51d1132, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:15.635123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:15.770458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1211/2444] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:22:15 2022] PUT /identity/v3/projects/4e6d862af1e642c18fe896d51870516b/users/bcb6998200e04d77a3eb020eb51d1132/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:15.783114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ddd81-8a05-4df5-909d-44b45d776da9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:15.783424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ddd81-8a05-4df5-909d-44b45d776da9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:15.783667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ddd81-8a05-4df5-909d-44b45d776da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:15.814752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:15.818429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bd4ddd81-8a05-4df5-909d-44b45d776da9 None None] MFA Rules not processed for user `bcb6998200e04d77a3eb020eb51d1132`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:15.819872 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bd4ddd81-8a05-4df5-909d-44b45d776da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:15.911310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1234/2445] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:15.923049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:15.925034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:15.944259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:16.020735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.021022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.021567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.022010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee383-5a78-49bb-b448-4985ececb3a9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.034090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.036072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.036072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.036616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.046017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.047591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.059658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1212/2446] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:16.087223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] MFA Rules not processed for user `8ff5d6212ea2438aabb3c47eb37eea78`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:16.097350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:16.208257 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1235/2447] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:22:16.209760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:16.211378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:16.323514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445dce5-b05d-464c-8b48-08ea82c5b9f8 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.328940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.329588 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.329866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.330139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.330772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.333438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.428771 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1213/2448] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:22:16.432971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:16.445558 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3a7d5-3e21-4008-a651-e8af5bb61cf4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.512937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.513539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.513809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.514082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.514736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.516767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.630229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1236/2449] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:22:16 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:22:16.639838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:16.644951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e22cdd-d2e2-4b85-b7b9-a7149aedd182 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.650033 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.650761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.651252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.651617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.652410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.654412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.675127 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1214/2450] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:22:16.676865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:16.695101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844416c-b223-4ec7-a03d-3dc61769dd75 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.700569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.701417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.707127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.707127 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] PATH_INFO: `/v3/projects/a1b4f82c34e14d83a667d40257ff5ea5/users/10876ecf0c9946e891c2217cc6bd6592/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.719663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b4f82c34e14d83a667d40257ff5ea5, user_id=10876ecf0c9946e891c2217cc6bd6592, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.722473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.775316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:16.785229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1237/2451] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:22:16 2022] PUT /identity/v3/projects/a1b4f82c34e14d83a667d40257ff5ea5/users/10876ecf0c9946e891c2217cc6bd6592/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:16.790785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:16.802945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238252-b3fd-4f55-b6ce-b1638896efb8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.872794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b22e1d-7333-48a3-821d-c8568a45a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.873501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22e1d-7333-48a3-821d-c8568a45a69b admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.873715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22e1d-7333-48a3-821d-c8568a45a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.873984 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b22e1d-7333-48a3-821d-c8568a45a69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.880430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22e1d-7333-48a3-821d-c8568a45a69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.882348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b22e1d-7333-48a3-821d-c8568a45a69b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.893709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1215/2452] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:22:16.899120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:16.912792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32310fdd-b1ac-4ccb-82a2-915d8de3d602 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:16.917968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:16.923596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:16.923596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:16.923596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] PATH_INFO: `/v3/projects/a1b4f82c34e14d83a667d40257ff5ea5/users/10876ecf0c9946e891c2217cc6bd6592/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:16.923596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b4f82c34e14d83a667d40257ff5ea5, user_id=10876ecf0c9946e891c2217cc6bd6592, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:16.924285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:16.935756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1238/2453] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:22:16 2022] PUT /identity/v3/projects/a1b4f82c34e14d83a667d40257ff5ea5/users/10876ecf0c9946e891c2217cc6bd6592/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:24.323824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:24.324479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:24.324479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:24.355724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] MFA Rules not processed for user `10876ecf0c9946e891c2217cc6bd6592`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:24.357095 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:24.376845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:24.449911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1216/2454] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:24.464535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:24.466362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:24.551385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2821573-4419-470b-bf22-b5ed789e6bfc admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:24.557600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8892a8b-ba1c-4b66-a277-ffd45deff124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:24.558434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8892a8b-ba1c-4b66-a277-ffd45deff124 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:24.558884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8892a8b-ba1c-4b66-a277-ffd45deff124 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:24.559312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8892a8b-ba1c-4b66-a277-ffd45deff124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:24.634478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8892a8b-ba1c-4b66-a277-ffd45deff124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:24.634478 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8892a8b-ba1c-4b66-a277-ffd45deff124 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:24.641900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1239/2455] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:25.084978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:25.159559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c8846-d116-4353-bc0a-21726063b614 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:25.164621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:25.165252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:25.165553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:25.171585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] PATH_INFO: `/v3/users/bcb6998200e04d77a3eb020eb51d1132` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:25.171585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb6998200e04d77a3eb020eb51d1132)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:25.171585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:25.384514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb6998200e04d77a3eb020eb51d1132'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:25.385282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb6998200e04d77a3eb020eb51d1132'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:25.385977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb6998200e04d77a3eb020eb51d1132'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:25.393497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb6998200e04d77a3eb020eb51d1132'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:25.408803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb6998200e04d77a3eb020eb51d1132'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:25.513138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1217/2456] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:22:25 2022] DELETE /identity/v3/users/bcb6998200e04d77a3eb020eb51d1132 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:25.518710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:25.520412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:25.520680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:25.544727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:25.552114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:25.636475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1240/2457] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:25.648687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:25.650139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:25.695718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:25.726096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84add528-9391-48d4-819f-57483768ba4a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:25.727494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8047f66-6d38-4563-b1dd-2c7a2a0281a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:25.728207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047f66-6d38-4563-b1dd-2c7a2a0281a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:25.728489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047f66-6d38-4563-b1dd-2c7a2a0281a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:25.728760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8047f66-6d38-4563-b1dd-2c7a2a0281a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:25.739632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8047f66-6d38-4563-b1dd-2c7a2a0281a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:25.741121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8047f66-6d38-4563-b1dd-2c7a2a0281a2 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:25.751548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1218/2458] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:26.507405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:26.512420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:26.523708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01268e-7212-4466-87b3-a3cfeb6568e1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:26.529919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:26.530950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:26.530950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:26.531180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] PATH_INFO: `/v3/projects/4e6d862af1e642c18fe896d51870516b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:26.532330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6d862af1e642c18fe896d51870516b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:26.534233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:26.552946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:26.639853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6d862af1e642c18fe896d51870516b', 'request_id': 'req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:26.646781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6d862af1e642c18fe896d51870516b', 'request_id': 'req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:26.652871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6d862af1e642c18fe896d51870516b', 'request_id': 'req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:26.728409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] The token cache is being invalidate because project 4e6d862af1e642c18fe896d51870516b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:22:26.745871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:26.745871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2f1c3351-8aae-4c29-8e23-23ced48ee7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:22:26.745871 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1241/2459] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:22:26 2022] DELETE /identity/v3/projects/4e6d862af1e642c18fe896d51870516b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:22:28.027591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:28.028360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:28.028828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:28.050100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] MFA Rules not processed for user `8ff5d6212ea2438aabb3c47eb37eea78`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:28.051516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:28.128255 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1219/2460] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:22:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:30.076685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:30.077159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:30.077159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:30.099097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:30.100415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:30.161998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1242/2461] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:30.185718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:30.187151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:30.262328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eb330-baa2-4db4-979a-6ad6c575ac28 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:30.267876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83983bf-c6df-44cc-aff6-11bb62428eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:30.268518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83983bf-c6df-44cc-aff6-11bb62428eb0 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:30.268805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83983bf-c6df-44cc-aff6-11bb62428eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:30.269070 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83983bf-c6df-44cc-aff6-11bb62428eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:30.277288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83983bf-c6df-44cc-aff6-11bb62428eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:30.278868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83983bf-c6df-44cc-aff6-11bb62428eb0 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:30.289097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1220/2462] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:31.278923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:31.280461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:31.369726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fc129-8815-442c-a83f-511809050a6d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:31.377584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:31.378946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:31.379453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:31.379850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:31.381849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:31.394256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:31.395855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:31.406944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1243/2463] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:36.445334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78417f3c-d581-4d48-8831-568a8c2fcf5a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:36.446032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78417f3c-d581-4d48-8831-568a8c2fcf5a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:36.446032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78417f3c-d581-4d48-8831-568a8c2fcf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:36.465611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-78417f3c-d581-4d48-8831-568a8c2fcf5a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:36.466834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-78417f3c-d581-4d48-8831-568a8c2fcf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:36.474944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1221/2464] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:22:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:36.498691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:36.511957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a91cac-2ad5-47ee-868d-98c1011bc28d service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:36.517766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:36.518644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:36.518937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:36.519195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:36.527631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:36.529250 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:36.540034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1244/2465] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:43.936363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:43.936900 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:43.937010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:43.956892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:22:43.961877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:43.965910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1222/2466] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:22:43.999166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:44.011373 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9e72-e2f0-4717-81b4-1031854f40e1 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:44.020459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcb17d-2297-4519-a84b-d05de8e2b371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:44.020459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb17d-2297-4519-a84b-d05de8e2b371 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:44.020459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb17d-2297-4519-a84b-d05de8e2b371 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:44.020459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcb17d-2297-4519-a84b-d05de8e2b371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:44.026245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcb17d-2297-4519-a84b-d05de8e2b371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:44.027807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcb17d-2297-4519-a84b-d05de8e2b371 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:44.037651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1245/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:47.906722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:22:47.908206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:47.960844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:47.965037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37d31a-918f-4329-abc3-96d95876e524 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:22:47.968657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:22:47.969262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:22:47.969540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:22:47.969811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:22:47.971550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:22:48.035128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:22:48.036635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:22:48.046138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1223/2468] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:22:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:22:54.033154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:22:58.041780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=28 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:00.954782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433e07-151e-4508-86ee-de993bd124eb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:00.954782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433e07-151e-4508-86ee-de993bd124eb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:00.955269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06433e07-151e-4508-86ee-de993bd124eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:00.980586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-06433e07-151e-4508-86ee-de993bd124eb None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:00.982785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06433e07-151e-4508-86ee-de993bd124eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:01.056850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1246/2469] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:23:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:01.081850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:01.083401 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:01.186298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e5986-b986-4537-a8c8-cef23cc2c71d service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:01.192319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:01.192935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:01.193203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:01.193465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:01.203692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:01.205880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:01.214583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1224/2470] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:23:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:08.120663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5229da-316a-49b0-a040-9513ac7168da None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:08.121296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5229da-316a-49b0-a040-9513ac7168da None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:08.121296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5229da-316a-49b0-a040-9513ac7168da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:08.142817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1c5229da-316a-49b0-a040-9513ac7168da None None] MFA Rules not processed for user `c1bc0ae9259d4669b9037317df055b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:08.144619 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1c5229da-316a-49b0-a040-9513ac7168da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:08.216121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1247/2471] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:23:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:11.210994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=32 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:17.926637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:17.935985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f65d0a-7b88-4107-a628-683159a31bd4 service swift] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:17.939590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:17.940279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:17.940669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:17.940981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:17.942709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:18.004857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:18.006297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98837602-f910-4360-93d1-d5e206a1ad54 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:18.015837 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1225/2472] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:23:18.205910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=50 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:25.886167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3337ad-fb41-4e45-b9ec-7e149543e5b5 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:25.886842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3337ad-fb41-4e45-b9ec-7e149543e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:25.887160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3337ad-fb41-4e45-b9ec-7e149543e5b5 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:25.889361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1248/2473] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:23:25.895518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596556f6-030c-495b-a9f4-98f303f227b0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:25.896001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596556f6-030c-495b-a9f4-98f303f227b0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:25.896152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596556f6-030c-495b-a9f4-98f303f227b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:25.916559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-596556f6-030c-495b-a9f4-98f303f227b0 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:25.922989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-596556f6-030c-495b-a9f4-98f303f227b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:25.928647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1226/2474] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:23:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:25.942207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3337ad-fb41-4e45-b9ec-7e149543e5b5 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:25.944230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd3337ad-fb41-4e45-b9ec-7e149543e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:26.007317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3337ad-fb41-4e45-b9ec-7e149543e5b5 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:26.011054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cbfa-b6d0-4487-80d3-dd2073bef1d5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:26.011655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cbfa-b6d0-4487-80d3-dd2073bef1d5 service glance] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.011932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cbfa-b6d0-4487-80d3-dd2073bef1d5 service glance] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.012240 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cbfa-b6d0-4487-80d3-dd2073bef1d5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.022313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28cbfa-b6d0-4487-80d3-dd2073bef1d5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:26.023734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28cbfa-b6d0-4487-80d3-dd2073bef1d5 service glance] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:26.034597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1249/2475] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:23:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:23:26.300409 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde2b28-e5b0-467f-9a7b-c5c63e3f2e5e None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.300614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde2b28-e5b0-467f-9a7b-c5c63e3f2e5e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.300868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde2b28-e5b0-467f-9a7b-c5c63e3f2e5e None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.302225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1227/2476] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:23:26.309290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90de69-d0a0-4144-86db-acc244fea940 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.309569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90de69-d0a0-4144-86db-acc244fea940 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.309903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90de69-d0a0-4144-86db-acc244fea940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.339340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7d90de69-d0a0-4144-86db-acc244fea940 None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:26.340637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7d90de69-d0a0-4144-86db-acc244fea940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:26.347955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1250/2477] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:23:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:26.360049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde2b28-e5b0-467f-9a7b-c5c63e3f2e5e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:26.361774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-bdde2b28-e5b0-467f-9a7b-c5c63e3f2e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:26.378313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde2b28-e5b0-467f-9a7b-c5c63e3f2e5e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:26.383971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27b7f8-ad29-4d3f-af51-654faae2a03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:26.384858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27b7f8-ad29-4d3f-af51-654faae2a03c service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.385284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27b7f8-ad29-4d3f-af51-654faae2a03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.385702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27b7f8-ad29-4d3f-af51-654faae2a03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.393767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27b7f8-ad29-4d3f-af51-654faae2a03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:26.395226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27b7f8-ad29-4d3f-af51-654faae2a03c service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:26.403650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1228/2478] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:23:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:23:26.490187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846bbd-998a-4c8a-9075-8bddd8b547e4 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.490534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846bbd-998a-4c8a-9075-8bddd8b547e4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.490806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846bbd-998a-4c8a-9075-8bddd8b547e4 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.492582 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1251/2479] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:23:26.500742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93856fd0-0b43-4be6-b331-0612d666ef48 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.500742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93856fd0-0b43-4be6-b331-0612d666ef48 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.500742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93856fd0-0b43-4be6-b331-0612d666ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.521738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-93856fd0-0b43-4be6-b331-0612d666ef48 None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:26.522949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-93856fd0-0b43-4be6-b331-0612d666ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:26.533294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1229/2480] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:23:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:26.545100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846bbd-998a-4c8a-9075-8bddd8b547e4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:26.556384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846bbd-998a-4c8a-9075-8bddd8b547e4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:26.560289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:26.561217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:26.561685 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:26.562122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:26.585606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:26.587036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:26.600625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1252/2481] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:23:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:23:31.619272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89f30b-8a1a-4a15-995f-8393018b2752 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:31.619811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89f30b-8a1a-4a15-995f-8393018b2752 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:31.619811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89f30b-8a1a-4a15-995f-8393018b2752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:31.640402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dd89f30b-8a1a-4a15-995f-8393018b2752 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:31.641613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dd89f30b-8a1a-4a15-995f-8393018b2752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:31.650715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1230/2482] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:31.688563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:31.700436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909285a-fa25-4024-a81c-b781d948233d service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:31.706859 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:31.707499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:31.707771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:31.708034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:31.717024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:31.718499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:31.728116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1253/2483] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:23:33.102496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de899f-cb71-4a48-97e2-803c697642ef None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:33.103023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de899f-cb71-4a48-97e2-803c697642ef None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:33.103023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de899f-cb71-4a48-97e2-803c697642ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:33.122001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c5de899f-cb71-4a48-97e2-803c697642ef None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:33.123183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c5de899f-cb71-4a48-97e2-803c697642ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:33.130954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1231/2484] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:33.143040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:33.154325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88767b7-d0cc-4272-ab76-9b668cc332bd service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:33.160042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:33.160698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:33.160972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:33.161238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:33.169231 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:33.170782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:33.179344 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1254/2485] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:23:43.117160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=48 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:43.176113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=47 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:23:52.898903 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1764d-7998-44f3-981d-1462735a90c0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:52.899452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1764d-7998-44f3-981d-1462735a90c0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:52.899452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1764d-7998-44f3-981d-1462735a90c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:52.920175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-cfa1764d-7998-44f3-981d-1462735a90c0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:23:52.921257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cfa1764d-7998-44f3-981d-1462735a90c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:52.929618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1232/2486] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:23:52.950970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:23:52.952422 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:23:52.967768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff428dd5-7bdf-46ed-ab6b-0309d1ba82ea service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:23:52.973341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:23:52.973934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:23:52.974248 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:23:52.974460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:23:52.982534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:23:52.984106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:23:52.994040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1255/2487] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:01.839044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a142b-8b60-42e7-a5d8-545dd739d02a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:01.839604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a142b-8b60-42e7-a5d8-545dd739d02a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:01.839604 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a142b-8b60-42e7-a5d8-545dd739d02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:01.860915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6f4a142b-8b60-42e7-a5d8-545dd739d02a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:01.862113 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6f4a142b-8b60-42e7-a5d8-545dd739d02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:01.869972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1233/2488] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:24:01.893975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:01.905162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d687-bb0a-4d11-927e-132ee31e090e service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:01.911908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:01.912554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:01.912828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:01.913094 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:01.921495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:01.923275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:01.933388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1256/2489] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:03.239744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a9cc-3aed-4163-a7fe-75ef3c674b5e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:03.239744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a9cc-3aed-4163-a7fe-75ef3c674b5e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:03.239744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a9cc-3aed-4163-a7fe-75ef3c674b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:03.256359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-36b1a9cc-3aed-4163-a7fe-75ef3c674b5e None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:03.257568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-36b1a9cc-3aed-4163-a7fe-75ef3c674b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:03.265505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1234/2490] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 7 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:24:03.288918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:03.300354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d88a7-bac9-42ab-9c3a-c02b15937262 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:03.305396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:03.305995 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:03.306270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:03.306539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:03.315181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:03.316875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:03.325361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1257/2491] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:24:08.250868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652bb89-b4c3-4843-9881-9ebb67323598 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:08.251434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652bb89-b4c3-4843-9881-9ebb67323598 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:08.251434 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652bb89-b4c3-4843-9881-9ebb67323598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:08.271046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b652bb89-b4c3-4843-9881-9ebb67323598 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:08.272291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b652bb89-b4c3-4843-9881-9ebb67323598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:08.280223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1235/2492] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:24:08.302741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:08.314534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae454a45-0700-49b0-9e75-60c234d5bd52 service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:08.320423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:08.321017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:08.321286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:08.321553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:08.329955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:08.332726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:08.341350 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1258/2493] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:13.593695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:13.594800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:13.594800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:13.602368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=13 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:13.614973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:13.616869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:13.623919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1236/2494] 10.222.0.77 () {58 vars in 1016 bytes} [Wed Sep 7 13:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:24:13.658406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:13.664150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=25 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:13.670204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86aa45-d821-487e-8d8c-546ae81a5bbe service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:13.676485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:13.677696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:13.677696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:13.677696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:13.685742 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:13.687290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:13.696674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1259/2495] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:22.739770 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:22.749426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b6613-104a-4048-b62d-77ec1a420083 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:22.753043 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:22.753634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:22.753907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:22.754269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:22.755972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:22.769429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:22.770843 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:22.782137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1237/2496] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:24:23.702017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:25.305819 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:25.315358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff9906-f934-43bd-bf24-3ae8a1b77bc2 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:25.318932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:25.319520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:25.319809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:25.320074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:25.321796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:25.335786 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:25.337275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825066f-0f98-4aff-b158-0a83f68d44ff service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:25.349081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1260/2497] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:29.794826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:29.806258 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0894059-731d-4877-9871-12e34f806942 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:29.811688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:29.812334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:29.812637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:29.812909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:29.814676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:29.873882 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:29.875293 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:29.885460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1238/2498] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:31.311659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:31.312304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:31.312304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:31.331921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] MFA Rules not processed for user `438568aef00b421da7419f77a2fd7180`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:31.333227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:31.340128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1261/2499] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:24:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:24:34.821253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:34.822695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:34.878772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd41dd2-3656-4e3a-a659-6ed04fb09565 service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:34.882333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:34.882928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:34.883197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:34.883458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:34.885152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:34.943581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:34.945083 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:34.954302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1239/2500] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:24:41.326397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=9 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:44.949889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=84 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:24:54.695700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:54.705699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdf47f-6078-41cb-970f-e502e5113c0e None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:54.709355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:54.709984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:54.710262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:54.710529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:54.712327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:54.722645 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:54.724075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:54.732485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1262/2501] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:24:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:24:58.751718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:58.755376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:58.767423 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcd4ac-af2a-4106-9aa3-deeba05d384e service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:58.772305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:58.772936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:58.773212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:58.773574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] PATH_INFO: `/v3/users/c1bc0ae9259d4669b9037317df055b6f` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:58.774715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bc0ae9259d4669b9037317df055b6f)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:58.776801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:59.005148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bc0ae9259d4669b9037317df055b6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.005780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bc0ae9259d4669b9037317df055b6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.006407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bc0ae9259d4669b9037317df055b6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.013372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bc0ae9259d4669b9037317df055b6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.025739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-aef22c83-4bca-461c-b93b-8fcbaac1d8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bc0ae9259d4669b9037317df055b6f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.093801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1240/2502] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:24:58 2022] DELETE /identity/v3/users/c1bc0ae9259d4669b9037317df055b6f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:24:59.348521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:59.360301 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad30e-4e57-4a59-a425-4744a801206a service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:59.418805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:59.419442 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:59.419719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:59.420022 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] PATH_INFO: `/v3/projects/54c4facf792d4675a4fe0a97c2451066` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:59.421232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c4facf792d4675a4fe0a97c2451066)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:59.423170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:59.530696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c4facf792d4675a4fe0a97c2451066', 'request_id': 'req-a3cf826c-9f49-4205-98a5-2ba02b77a231'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.537172 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c4facf792d4675a4fe0a97c2451066', 'request_id': 'req-a3cf826c-9f49-4205-98a5-2ba02b77a231'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.542720 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c4facf792d4675a4fe0a97c2451066', 'request_id': 'req-a3cf826c-9f49-4205-98a5-2ba02b77a231'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.642384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] The token cache is being invalidate because project 54c4facf792d4675a4fe0a97c2451066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:24:59.647733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.647733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a3cf826c-9f49-4205-98a5-2ba02b77a231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:24:59.647733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1263/2503] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:24:59 2022] DELETE /identity/v3/projects/54c4facf792d4675a4fe0a97c2451066 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:24:59.649920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:59.650277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:59.650623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:59.671355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:59.672597 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:59.730833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1241/2504] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:24:59.738571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:59.738858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:59.739133 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:59.758855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:24:59.760063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:24:59.768671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1264/2505] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:24:59.773018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:59.783652 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eac308-816a-40fc-97b3-870f13b24ee2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:59.788276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:59.788869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:59.789147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:59.789419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:59.790078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:24:59.790365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:59.791978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:59.803897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1242/2506] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:24:59.808136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:59.817278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac395bbb-0be5-41b2-8bbc-9277c0ad99a4 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:59.822071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:59.822670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:59.822945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:59.823211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:59.823842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:59.825793 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:59.908839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1265/2507] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:24:59 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:24:59.912909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:24:59.923008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e48c3-a209-47f5-9b22-ebe16161f43c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:24:59.980440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:24:59.981054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:24:59.981328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:24:59.981598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:24:59.982240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:24:59.984201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:24:59.992217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:00.122447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1243/2508] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:24:59 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:25:00.127222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:00.137395 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e2d83-eb0c-418c-bb67-408f91629669 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:00.142678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:00.143270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:00.143543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:00.143815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:00.144493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:00.146142 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:00.158102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1266/2509] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:25:00.161927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:00.171879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aa6c8-c035-41d1-b5ed-9cb41d031509 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:00.176629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600a1ba-7199-43da-83fc-187f87625a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:00.177218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a1ba-7199-43da-83fc-187f87625a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:00.177498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a1ba-7199-43da-83fc-187f87625a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:00.177794 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a1ba-7199-43da-83fc-187f87625a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:00.178455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600a1ba-7199-43da-83fc-187f87625a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:00.180039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600a1ba-7199-43da-83fc-187f87625a7e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:00.190970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1244/2510] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:25:00.195096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:00.205768 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d98dbb-f8ec-4fc7-a317-343c78065836 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:00.210280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:00.210926 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:00.211195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:00.211463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] PATH_INFO: `/v3/projects/570794347eaf4f7cbaa324a857429a56/users/c07ed414ecc5459691fe742fa8200909/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:00.225847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=570794347eaf4f7cbaa324a857429a56, user_id=c07ed414ecc5459691fe742fa8200909, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:00.228569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:00.306586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1267/2511] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:25:00 2022] PUT /identity/v3/projects/570794347eaf4f7cbaa324a857429a56/users/c07ed414ecc5459691fe742fa8200909/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:25:00.375262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:00.375540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:00.375810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:00.403150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] MFA Rules not processed for user `c07ed414ecc5459691fe742fa8200909`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:25:00.404424 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:00.468142 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1245/2512] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:25:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:25:00.478830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:00.480520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:00.495331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:00.538867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6e3f9-a20e-450f-934e-f48721baf9de admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:00.542604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:00.543208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:00.543494 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:00.543764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:00.552638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:00.554128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:00.563814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1268/2513] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:10.465161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:10.598010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=20 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:13.576201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:13.639785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c493c18-9450-4c1b-a6a9-56669567e51d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:13.644356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:13.644994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:13.645292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:13.645566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] PATH_INFO: `/v3/users/c07ed414ecc5459691fe742fa8200909` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:13.646698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07ed414ecc5459691fe742fa8200909)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:13.648671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:13.690100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:13.690100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:13.761034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84481e1-d2fb-4c82-a0b7-06ee7efed09a service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:13.767199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:13.767893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:13.768201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:13.768470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:13.770178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:13.828942 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:13.830671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea550645-c947-4e94-836f-771eb11e4e13 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:13.839903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1269/2514] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:25:13.938382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07ed414ecc5459691fe742fa8200909'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:13.939108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07ed414ecc5459691fe742fa8200909'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:13.939781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07ed414ecc5459691fe742fa8200909'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:13.946899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07ed414ecc5459691fe742fa8200909'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:13.960439 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07ed414ecc5459691fe742fa8200909'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:14.083642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1246/2515] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:25:13 2022] DELETE /identity/v3/users/c07ed414ecc5459691fe742fa8200909 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:25:14.089537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:14.089537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:14.089537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:14.108070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:25:14.109325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:14.169435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1270/2516] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:25:14.179366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:14.180795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:14.239079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281024c-843f-4de2-8fbe-02382cffd0a2 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:14.242647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:14.243244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:14.243517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:14.243786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:14.253528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:14.254971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:14.264594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1247/2517] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:14.771253 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:14.772708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:14.786166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d22a12-2935-4145-9d2b-5ab6bc05d1f6 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:14.791023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:14.791658 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:14.791934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:14.792233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] PATH_INFO: `/v3/projects/570794347eaf4f7cbaa324a857429a56` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:14.793343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=570794347eaf4f7cbaa324a857429a56)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:14.795304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:14.900001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:14.912527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570794347eaf4f7cbaa324a857429a56', 'request_id': 'req-ef0f817b-78fc-4804-b77e-537ca43b8381'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:14.918652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570794347eaf4f7cbaa324a857429a56', 'request_id': 'req-ef0f817b-78fc-4804-b77e-537ca43b8381'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:14.924101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570794347eaf4f7cbaa324a857429a56', 'request_id': 'req-ef0f817b-78fc-4804-b77e-537ca43b8381'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:15.029556 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] The token cache is being invalidate because project 570794347eaf4f7cbaa324a857429a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:25:15.029774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:15.030439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ef0f817b-78fc-4804-b77e-537ca43b8381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:25:15.031990 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1271/2518] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:25:14 2022] DELETE /identity/v3/projects/570794347eaf4f7cbaa324a857429a56 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:25:20.656767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:20.658456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:20.693419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:20.743158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e32b8-8f63-4608-ad8c-d7b56794e1ce service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:20.814071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:20.814963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:20.815242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:20.815540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:20.817337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:20.830121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:20.831752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:20.843752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1248/2519] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:25.037549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:26.180397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:26.185409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:26.185723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:26.209597 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] MFA Rules not processed for user `cb3e13c85e8545afab44389368eb91dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:25:26.210808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:26.267605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1272/2520] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:25:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:25:26.588496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:26.590060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:26.656702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05884f73-a438-49ad-944e-b6a6f8041d7d service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:26.660724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:26.661334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:26.661634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:26.661929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:26.663701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:26.673634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:26.675058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:26.683092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1249/2521] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:27.095420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:27.096836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:27.167325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b38ca-fc14-42e0-9fd2-b6a35c87fc45 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:27.172401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:27.173131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:27.173412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:27.173679 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:27.175430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:27.187542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:27.189239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:27.199670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1273/2522] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:36.679490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=78 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:37.194934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=57 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:25:40.071445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:25:40.073045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:40.089152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0202ed0-8c07-4585-aa8a-fe22b32a8281 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:25:40.094849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:25:40.095460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:25:40.095759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:25:40.096010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:25:40.097810 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:25:40.110928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:25:40.112540 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:25:40.125112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1250/2523] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:25:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:25:50.119889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=6 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:09.454671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:09.456719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:09.468625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46e5f3-2552-415c-960c-6d34863c7019 service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:09.472983 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:09.473620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:09.473891 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:09.474155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:09.475883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:09.545586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:09.547028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:09.557520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1274/2524] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:13.344428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:13.346065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:13.366724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c464-c68a-4c6f-ac16-bc32873b701b service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:13.372002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:13.372653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:13.372930 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:13.373200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:13.375002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:13.388257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:13.395096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7501f28-ae98-400a-bcfa-6dcf1135a511 service placement] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:13.401025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1251/2525] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:13.521427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:13.522884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:13.536221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c368e7-419b-497a-8d0d-d403ce99f755 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:13.540952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:13.541591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:13.542357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:13.542357 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] PATH_INFO: `/v3/users/438568aef00b421da7419f77a2fd7180` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:13.543339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=438568aef00b421da7419f77a2fd7180)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:13.545304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:13.815120 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438568aef00b421da7419f77a2fd7180'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:13.815782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438568aef00b421da7419f77a2fd7180'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:13.822747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438568aef00b421da7419f77a2fd7180'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:13.835703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438568aef00b421da7419f77a2fd7180'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:13.836627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438568aef00b421da7419f77a2fd7180'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:13.945734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1275/2526] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:13 2022] DELETE /identity/v3/users/438568aef00b421da7419f77a2fd7180 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:14.063850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.065450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.065450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.101966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:14.103371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:14.176021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1252/2527] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 7 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:14.329105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:14.331371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:14.357411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:14.359433 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:14.428486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ecf82-663d-4b97-850e-019b6d6acf8f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:14.433897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:14.434665 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.435047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.435443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] PATH_INFO: `/v3/projects/114e8e1e21f64769944d92d7bd9db345` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.436829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=114e8e1e21f64769944d92d7bd9db345)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:14.438941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:14.449740 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:14.490750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e2ad-90cd-495c-a455-b7654045e313 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:14.495819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae249b86-dd0a-4d2a-8096-3c92c3dc36df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:14.496528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249b86-dd0a-4d2a-8096-3c92c3dc36df service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.496830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249b86-dd0a-4d2a-8096-3c92c3dc36df service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.497103 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae249b86-dd0a-4d2a-8096-3c92c3dc36df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.506410 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249b86-dd0a-4d2a-8096-3c92c3dc36df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:14.507834 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae249b86-dd0a-4d2a-8096-3c92c3dc36df service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:14.518188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1253/2528] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:26:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 07 13:26:14.631331 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114e8e1e21f64769944d92d7bd9db345', 'request_id': 'req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:14.637785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114e8e1e21f64769944d92d7bd9db345', 'request_id': 'req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:14.643579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114e8e1e21f64769944d92d7bd9db345', 'request_id': 'req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:14.799394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] The token cache is being invalidate because project 114e8e1e21f64769944d92d7bd9db345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:14.799394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:14.799394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-11e9399c-cea6-4f4f-a58f-fb83ac1120d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:14.799394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1276/2529] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:14 2022] DELETE /identity/v3/projects/114e8e1e21f64769944d92d7bd9db345 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:14.805716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.806141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.806420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.826234 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:14.827562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:14.887846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1254/2530] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:14.896214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.896501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.896774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.918863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:14.920031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:14.929082 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1277/2531] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:14.933402 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:14.946735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdb00a-ccaa-4e77-a07c-8b4075eb8ae7 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:14.951569 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:14.952397 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.952559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.952774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.953416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:26:14.953756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:14.955400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:14.968101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1255/2532] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:26:14.972842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:14.981886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa70de-8827-4983-9c5f-196e074e3b7b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:14.986652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:14.987269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:14.987536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:14.987801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:14.988488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:14.990391 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:15.119475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1278/2533] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:26:14 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:15.123944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:15.135297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f44ad-b746-4842-97fd-2cd5d99c2caa admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:15.140151 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:15.193442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:15.194094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:15.194373 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:15.194641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:15.195266 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:15.197262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:15.282399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1256/2534] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:26:15 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:15.286691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:15.297200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446dd5ca-5001-4bb1-84ea-cbb7f4c52d91 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:15.302532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:15.311192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:15.313526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:15.313526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:15.313526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:15.314154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:15.325424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1279/2535] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:15.329776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:15.341229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04478-bd46-4235-98b1-f0d82e80ffdf admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:15.344869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d639f-9ce5-4a19-955e-95670d216891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:15.345475 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d639f-9ce5-4a19-955e-95670d216891 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:15.345752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d639f-9ce5-4a19-955e-95670d216891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:15.346028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d639f-9ce5-4a19-955e-95670d216891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:15.346028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d639f-9ce5-4a19-955e-95670d216891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:15.349155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d639f-9ce5-4a19-955e-95670d216891 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:15.361273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1257/2536] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:15.367326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:15.375359 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b8726-19ab-4f24-afe3-2e5aa38d83f5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:15.381706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:15.382386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:15.382662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:15.382980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] PATH_INFO: `/v3/projects/47197255c7164e7a9a8a741f5fe56538/users/18f43c98f25b4faaa4f09469535187a6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:15.399392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47197255c7164e7a9a8a741f5fe56538, user_id=18f43c98f25b4faaa4f09469535187a6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:15.405108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:15.506828 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1280/2537] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:15 2022] PUT /identity/v3/projects/47197255c7164e7a9a8a741f5fe56538/users/18f43c98f25b4faaa4f09469535187a6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:26:15.518576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38a33-9263-490d-b41c-d1c769fbdca7 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:15.518856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38a33-9263-490d-b41c-d1c769fbdca7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:15.519123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38a33-9263-490d-b41c-d1c769fbdca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:15.551922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7af38a33-9263-490d-b41c-d1c769fbdca7 None None] MFA Rules not processed for user `18f43c98f25b4faaa4f09469535187a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:15.560164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7af38a33-9263-490d-b41c-d1c769fbdca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:15.628296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1258/2538] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:15.640285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:15.642078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:15.730865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58f35a-3c64-480b-9dec-c90020c72fe9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:15.737424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:15.738038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:15.738310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:15.738575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:15.746729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:15.748372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:15.757989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1281/2539] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:17.532823 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d633-9f42-472c-9e6d-88af64166644 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:17.533309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d633-9f42-472c-9e6d-88af64166644 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:17.533608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d633-9f42-472c-9e6d-88af64166644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:17.564624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6b46d633-9f42-472c-9e6d-88af64166644 None None] MFA Rules not processed for user `c650fb007aad4a42ae13906b127bd6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:17.566905 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6b46d633-9f42-472c-9e6d-88af64166644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:17.644747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1259/2540] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:17.979987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:17.979987 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:18.001059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:18.044276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041533e-42b5-45eb-a06b-2f2ea102c575 service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:18.048358 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:18.049083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:18.050001 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:18.050499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:18.052677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:18.063490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:18.065139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2e5f2-42d5-4341-9ea2-ba835b20f181 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:18.074175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1282/2541] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:20.357460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d94fc6-e8ee-4f55-90ed-b183a5b1d13c None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:20.357950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d94fc6-e8ee-4f55-90ed-b183a5b1d13c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:20.358060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d94fc6-e8ee-4f55-90ed-b183a5b1d13c None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:20.359416 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1260/2542] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 07 13:26:20.369896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:20.374480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:20.374480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:20.397555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] MFA Rules not processed for user `ef26df9666dd4e54aa9c76d4a1aa6cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:20.397555 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:20.463175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1283/2543] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:26:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:20.475801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d94fc6-e8ee-4f55-90ed-b183a5b1d13c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:20.477211 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a4d94fc6-e8ee-4f55-90ed-b183a5b1d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:20.494040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d94fc6-e8ee-4f55-90ed-b183a5b1d13c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:20.501229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34e5ad-01cb-4b8d-b62c-72c8bafa1f27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:20.504500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e5ad-01cb-4b8d-b62c-72c8bafa1f27 service placement] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:20.504500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e5ad-01cb-4b8d-b62c-72c8bafa1f27 service placement] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:20.504500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34e5ad-01cb-4b8d-b62c-72c8bafa1f27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:20.537199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e5ad-01cb-4b8d-b62c-72c8bafa1f27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:20.539154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34e5ad-01cb-4b8d-b62c-72c8bafa1f27 service placement] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:20.565818 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1261/2544] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:23.666905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:23.757782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929dfb-4a7e-417c-91c3-b02eebc3b0be None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:23.769723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:23.771014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:23.774993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:23.776063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] PATH_INFO: `/v3/users/18f43c98f25b4faaa4f09469535187a6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:23.777647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=18f43c98f25b4faaa4f09469535187a6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:23.780324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:24.032814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18f43c98f25b4faaa4f09469535187a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:24.034989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18f43c98f25b4faaa4f09469535187a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:24.042921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18f43c98f25b4faaa4f09469535187a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:24.045026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:24.057979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18f43c98f25b4faaa4f09469535187a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:24.059038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18f43c98f25b4faaa4f09469535187a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:24.154404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1284/2545] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:23 2022] DELETE /identity/v3/users/18f43c98f25b4faaa4f09469535187a6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:24.158970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:24.159761 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:24.160110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:24.188153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:24.189465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:24.193933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:24.257432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1262/2546] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:24.264020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:24.265514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:24.339946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc4ff-f2cd-4ddc-a19a-80c805d1ff1b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:24.344666 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448bf0-97e4-4761-8ef3-1ea17d8b9e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:24.345290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448bf0-97e4-4761-8ef3-1ea17d8b9e33 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:24.345579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448bf0-97e4-4761-8ef3-1ea17d8b9e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:24.346533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448bf0-97e4-4761-8ef3-1ea17d8b9e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:24.359919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74448bf0-97e4-4761-8ef3-1ea17d8b9e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:24.361593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74448bf0-97e4-4761-8ef3-1ea17d8b9e33 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:24.371678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1285/2547] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:25.238982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:25.240141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:25.254277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5e833-b7e3-456f-83fd-2dadbcbc0c95 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:25.259603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:25.269884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:25.269884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:25.269884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] PATH_INFO: `/v3/projects/47197255c7164e7a9a8a741f5fe56538` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:25.269884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47197255c7164e7a9a8a741f5fe56538)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:25.269884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:25.475620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47197255c7164e7a9a8a741f5fe56538', 'request_id': 'req-dbe89e44-5798-452b-9272-c83d5cf66c62'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:25.477305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47197255c7164e7a9a8a741f5fe56538', 'request_id': 'req-dbe89e44-5798-452b-9272-c83d5cf66c62'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:25.482896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47197255c7164e7a9a8a741f5fe56538', 'request_id': 'req-dbe89e44-5798-452b-9272-c83d5cf66c62'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:25.674595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] The token cache is being invalidate because project 47197255c7164e7a9a8a741f5fe56538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:25.674961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:25.675690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dbe89e44-5798-452b-9272-c83d5cf66c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:25.692132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1263/2548] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:25 2022] DELETE /identity/v3/projects/47197255c7164e7a9a8a741f5fe56538 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:25.692245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:25.692245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:25.692245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:25.705908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:25.707157 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:25.771467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1286/2549] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:25.779444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554e34-fc16-43f3-935b-366c223255aa None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:25.779729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554e34-fc16-43f3-935b-366c223255aa None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:25.780009 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554e34-fc16-43f3-935b-366c223255aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:25.802876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-49554e34-fc16-43f3-935b-366c223255aa None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:25.804116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-49554e34-fc16-43f3-935b-366c223255aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:25.812319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1264/2550] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:25.816805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:25.826601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35256a6c-c162-4c57-bb52-7dce436294f0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:25.831831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:25.832521 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:25.833394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:25.833671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:25.834345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:26:25.834644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:25.836283 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:25.849924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1287/2551] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:26:25.854086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554e34-fc16-43f3-935b-366c223255aa None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:25.863804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554e34-fc16-43f3-935b-366c223255aa None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:25.869148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:25.869821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:25.870097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:25.870359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:25.871016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:25.872940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:25.919447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:25.921368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:25.935093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fcb6d-914a-4983-80a5-bafdf503c256 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:25.940346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:25.944241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:25.944241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:25.944241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] PATH_INFO: `/v3/users/4d7191afba9744daa24d87c80732163a` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:25.944241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7191afba9744daa24d87c80732163a)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:25.944633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:25.998024 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1265/2552] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:26.001696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.068154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1ce1a-7416-49d9-ad21-741acbc3f0ed admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.073135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.073745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.074018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.074287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.074921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.076874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.087537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:26.161810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7191afba9744daa24d87c80732163a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.162460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7191afba9744daa24d87c80732163a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.169579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7191afba9744daa24d87c80732163a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.174832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:26.182368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1266/2553] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:26:26 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:26:26.183416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7191afba9744daa24d87c80732163a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.183557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.184154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5bafd087-c23b-47b1-9d5f-5ed41da8500d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7191afba9744daa24d87c80732163a'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.185181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:26.197350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e2934c-ebb6-452d-903e-e0aef8739b7b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.202721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.207399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.207399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.207399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.207399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.207399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.216677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1267/2554] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:26.221105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.230309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f396a-9734-419f-b890-abc32be9c1d3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.234914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.235461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.235730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.235992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.237236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.238870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.248676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1268/2555] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:26:26.257538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.266637 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6def9c-3c80-4070-b9cd-a6db490c6e31 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.271368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.271972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.272272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.272536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] PATH_INFO: `/v3/projects/f6d498e4e1b34be1b037c5a66d213ea4/users/17926d48b5d04277bc83d34235b0dbe4/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.281471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1288/2556] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:25 2022] DELETE /identity/v3/users/4d7191afba9744daa24d87c80732163a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:26.288025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d498e4e1b34be1b037c5a66d213ea4, user_id=17926d48b5d04277bc83d34235b0dbe4, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.290718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.404648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1269/2557] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:26 2022] PUT /identity/v3/projects/f6d498e4e1b34be1b037c5a66d213ea4/users/17926d48b5d04277bc83d34235b0dbe4/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:26:26.416371 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.416959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.417336 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.451777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] MFA Rules not processed for user `17926d48b5d04277bc83d34235b0dbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:26.453187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:26.525059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1289/2558] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:26:26.529527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.589988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972380-ed3d-470a-ac96-f706c864061f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.591909 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.593514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:26.596490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.596638 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.597053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.597310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.598073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.600181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.609941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1c601-57fc-442a-8266-ae331973adbb None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.615674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.616467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.616808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.617139 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] PATH_INFO: `/v3/projects/5489953069d1423ebd36e959ceaa317c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.618393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5489953069d1423ebd36e959ceaa317c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.620511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.759922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1270/2559] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:26:26 2022] POST /identity/v3/projects => generated 363 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:26.763648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.774183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5489953069d1423ebd36e959ceaa317c', 'request_id': 'req-5b23fccf-1a98-465f-9c68-2d99f9ade36c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.780602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5489953069d1423ebd36e959ceaa317c', 'request_id': 'req-5b23fccf-1a98-465f-9c68-2d99f9ade36c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.787403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5489953069d1423ebd36e959ceaa317c', 'request_id': 'req-5b23fccf-1a98-465f-9c68-2d99f9ade36c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.828859 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65412a4d-f0e2-48a8-afd9-4efce390ba33 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.834150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.834747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.835026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.835294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.835912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.838332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:26.915377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] The token cache is being invalidate because project 5489953069d1423ebd36e959ceaa317c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:26.915663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.916324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:26.917849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1290/2560] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:26 2022] DELETE /identity/v3/projects/5489953069d1423ebd36e959ceaa317c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:26.921777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.923042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:26.985073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1271/2561] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:26:26 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:26:26.987220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23fccf-1a98-465f-9c68-2d99f9ade36c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:26.988946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:26.990606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:26.992570 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:26.993212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:26.993491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:26.993763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] PATH_INFO: `/v3/users/5183095adb2f4f36958259ad3a969608` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:26.995114 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5183095adb2f4f36958259ad3a969608)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:26.997092 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.005183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b1510-0fe1-49e4-9a40-2d9ffa689351 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.010574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.011443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.011756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.012136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.012775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.014365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.014838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:27.026541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1272/2562] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:26:27.030477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:27.040825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43a5f8-2c20-49e5-9615-3a36b1ab1d2a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.045482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.046636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.046636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.046636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] PATH_INFO: `/v3/projects/5ba6d1693d0245d889da0fc0a80f9f5f/users/25fa6a166ba44e25beaeef81de443ae6/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.055291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:27.061618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba6d1693d0245d889da0fc0a80f9f5f, user_id=25fa6a166ba44e25beaeef81de443ae6, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.064278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.145268 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1273/2563] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:27 2022] PUT /identity/v3/projects/5ba6d1693d0245d889da0fc0a80f9f5f/users/25fa6a166ba44e25beaeef81de443ae6/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:26:27.149426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:27.212649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365b58-ffb1-4bbe-8241-5d9157d9b39b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.217287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5183095adb2f4f36958259ad3a969608'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.217948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5183095adb2f4f36958259ad3a969608'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.218981 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.219986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.219986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.220377 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.221606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.223248 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.226753 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5183095adb2f4f36958259ad3a969608'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.235730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1274/2564] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:26:27.240022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:27.247558 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5183095adb2f4f36958259ad3a969608'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.248289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5183095adb2f4f36958259ad3a969608'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.252076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afb6a2-abe2-4e30-a8f8-076ef146cc54 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.256952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec227692-88bb-4969-8d26-30cbe90feffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.257685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227692-88bb-4969-8d26-30cbe90feffb admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.258031 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227692-88bb-4969-8d26-30cbe90feffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.258376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec227692-88bb-4969-8d26-30cbe90feffb admin admin] PATH_INFO: `/v3/projects/5ba6d1693d0245d889da0fc0a80f9f5f/users/25fa6a166ba44e25beaeef81de443ae6/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.260398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec227692-88bb-4969-8d26-30cbe90feffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba6d1693d0245d889da0fc0a80f9f5f, user_id=25fa6a166ba44e25beaeef81de443ae6, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.263121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec227692-88bb-4969-8d26-30cbe90feffb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.273999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1275/2565] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:27 2022] PUT /identity/v3/projects/5ba6d1693d0245d889da0fc0a80f9f5f/users/25fa6a166ba44e25beaeef81de443ae6/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:27.286975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.289907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.289907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.320251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] MFA Rules not processed for user `25fa6a166ba44e25beaeef81de443ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:27.320251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:27.351654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1291/2566] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:26 2022] DELETE /identity/v3/users/5183095adb2f4f36958259ad3a969608 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:26:27.391806 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1276/2567] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:26:27.403835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:27.406218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:27.466323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179fcb1-18a1-4c1e-aa29-dac264cf6305 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.470178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.470842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.471122 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.471378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.531747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.534004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.543767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1292/2568] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:27.656193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:27.657995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:27.728943 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:27.737087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab53e1a-97ff-4895-a7cc-c976efd5eda0 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.796594 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.802490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.802490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.802490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] PATH_INFO: `/v3/projects/dc6a71adc82d494e83ab54826ba104f7` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.802490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6a71adc82d494e83ab54826ba104f7)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.802490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.810766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:27.821461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797bd1b-a684-4d0b-bca8-d63c6fdcf259 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:27.825392 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:27.825997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:27.826279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:27.826550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:27.828416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:27.847806 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:27.889429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:27.890893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3cf30-d90a-49ac-88f3-e46d68f2c6d5 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:27.900225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1293/2569] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:26:27.931929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6a71adc82d494e83ab54826ba104f7', 'request_id': 'req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.938295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6a71adc82d494e83ab54826ba104f7', 'request_id': 'req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:27.944744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6a71adc82d494e83ab54826ba104f7', 'request_id': 'req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:28.042049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] The token cache is being invalidate because project dc6a71adc82d494e83ab54826ba104f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:28.042449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:28.043177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f63e21a4-6904-4a9f-a7b4-4ff68e8ebc58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:28.044751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1277/2570] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:27 2022] DELETE /identity/v3/projects/dc6a71adc82d494e83ab54826ba104f7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:32.368459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b87199-fbe8-4673-90e9-0b7501645cf9 None None] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:32.369587 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b87199-fbe8-4673-90e9-0b7501645cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:32.370335 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b87199-fbe8-4673-90e9-0b7501645cf9 None None] PATH_INFO: `/` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:32.372186 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1294/2571] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:26:32.379692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172c07-9f30-4c1a-9361-6b303944e5d9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:32.380241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172c07-9f30-4c1a-9361-6b303944e5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:32.380578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172c07-9f30-4c1a-9361-6b303944e5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:32.416671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-73172c07-9f30-4c1a-9361-6b303944e5d9 None None] MFA Rules not processed for user `57192d85635c489997ea172156dc4695`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:32.416671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-73172c07-9f30-4c1a-9361-6b303944e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:32.470999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1278/2572] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:32.483817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b87199-fbe8-4673-90e9-0b7501645cf9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:32.485505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-61b87199-fbe8-4673-90e9-0b7501645cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:32.498518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b87199-fbe8-4673-90e9-0b7501645cf9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:32.502230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e51ff0-714e-4b60-89d5-1a0c4f180b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:32.502821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e51ff0-714e-4b60-89d5-1a0c4f180b9f service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:32.503097 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e51ff0-714e-4b60-89d5-1a0c4f180b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:32.503365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e51ff0-714e-4b60-89d5-1a0c4f180b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:32.510322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e51ff0-714e-4b60-89d5-1a0c4f180b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:32.511718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e51ff0-714e-4b60-89d5-1a0c4f180b9f service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:32.520703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1295/2573] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:32.612983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee56f-f798-4d8d-8b8b-3a31699c93e7 None None] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:32.613274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee56f-f798-4d8d-8b8b-3a31699c93e7 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:32.613543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ee56f-f798-4d8d-8b8b-3a31699c93e7 None None] PATH_INFO: `/` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:32.615290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1279/2574] 10.222.0.57 () {54 vars in 921 bytes} [Wed Sep 7 13:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 07 13:26:32.621279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:32.621616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:32.621893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:32.642251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] MFA Rules not processed for user `08d7cfc07ef940b99652044bc7879601`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:32.643503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:32.720770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1296/2575] 10.222.0.57 () {58 vars in 1018 bytes} [Wed Sep 7 13:26:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:32.733967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee56f-f798-4d8d-8b8b-3a31699c93e7 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:32.735687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5a7ee56f-f798-4d8d-8b8b-3a31699c93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:32.749082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ee56f-f798-4d8d-8b8b-3a31699c93e7 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:32.752721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ab8db-b51a-4a59-89a7-99ec9b1783d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:32.753321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab8db-b51a-4a59-89a7-99ec9b1783d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:32.754206 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab8db-b51a-4a59-89a7-99ec9b1783d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:32.754436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ab8db-b51a-4a59-89a7-99ec9b1783d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:32.764621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab8db-b51a-4a59-89a7-99ec9b1783d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:32.766246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ab8db-b51a-4a59-89a7-99ec9b1783d2 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:32.778017 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1280/2576] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:36.879618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:36.881285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:36.948075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a60592-f0ad-4fe0-9f7a-f3214344936c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:36.952905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:36.953739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:36.954024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:36.954294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] PATH_INFO: `/v3/users/17926d48b5d04277bc83d34235b0dbe4` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:36.955441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17926d48b5d04277bc83d34235b0dbe4)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:36.957447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:37.234721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:37.241297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17926d48b5d04277bc83d34235b0dbe4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:37.241937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17926d48b5d04277bc83d34235b0dbe4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:37.249447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17926d48b5d04277bc83d34235b0dbe4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:37.261797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17926d48b5d04277bc83d34235b0dbe4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:37.262534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17926d48b5d04277bc83d34235b0dbe4'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:37.350994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1297/2577] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:36 2022] DELETE /identity/v3/users/17926d48b5d04277bc83d34235b0dbe4 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:37.355452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:37.355997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:37.355997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:37.376418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:37.377722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:37.413222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:37.466381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1281/2578] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:37.477388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:37.480046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:37.548318 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d1131-8c3d-46f2-89a3-d8054aa3a995 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:37.551955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:37.552659 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:37.552941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:37.553210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:37.563266 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:37.564775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:37.574533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1298/2579] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:38.029939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:38.031687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:38.046241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d8a2a-3c8a-420c-a212-0d4a6061394e None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:38.049855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:38.051047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:38.051396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:38.051677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] PATH_INFO: `/v3/projects/f6d498e4e1b34be1b037c5a66d213ea4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:38.053197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d498e4e1b34be1b037c5a66d213ea4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:38.055049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:38.162894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d498e4e1b34be1b037c5a66d213ea4', 'request_id': 'req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.169775 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d498e4e1b34be1b037c5a66d213ea4', 'request_id': 'req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.176209 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d498e4e1b34be1b037c5a66d213ea4', 'request_id': 'req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.260262 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] The token cache is being invalidate because project f6d498e4e1b34be1b037c5a66d213ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:38.260590 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.261225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.264632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1282/2580] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:38 2022] DELETE /identity/v3/projects/f6d498e4e1b34be1b037c5a66d213ea4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:38.269951 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:38.280042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774cb36-1f16-47a5-b353-2854c2ee8291 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:38.340456 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:38.341220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:38.341567 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:38.341904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] PATH_INFO: `/v3/users/25fa6a166ba44e25beaeef81de443ae6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:38.343150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25fa6a166ba44e25beaeef81de443ae6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:38.345203 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:38.567849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25fa6a166ba44e25beaeef81de443ae6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.568463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25fa6a166ba44e25beaeef81de443ae6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.575815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25fa6a166ba44e25beaeef81de443ae6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.580644 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:38.593171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25fa6a166ba44e25beaeef81de443ae6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.593171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-8037ca7f-9e92-46f2-bb24-3574b7019e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25fa6a166ba44e25beaeef81de443ae6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:38.676455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1299/2581] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:38 2022] DELETE /identity/v3/users/25fa6a166ba44e25beaeef81de443ae6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:39.116649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.118071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:39.133976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf6239-c4bf-47c2-bd3b-39ac0ea7957e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.197064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.197694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.197983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.198251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] PATH_INFO: `/v3/projects/5ba6d1693d0245d889da0fc0a80f9f5f` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.199385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba6d1693d0245d889da0fc0a80f9f5f)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.201332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:39.302169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba6d1693d0245d889da0fc0a80f9f5f', 'request_id': 'req-0c119b96-2761-4b0a-a347-7134cec00d1d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:39.308428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba6d1693d0245d889da0fc0a80f9f5f', 'request_id': 'req-0c119b96-2761-4b0a-a347-7134cec00d1d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:39.309685 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:39.314449 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba6d1693d0245d889da0fc0a80f9f5f', 'request_id': 'req-0c119b96-2761-4b0a-a347-7134cec00d1d'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:39.401256 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] The token cache is being invalidate because project 5ba6d1693d0245d889da0fc0a80f9f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:39.401476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:39.402098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c119b96-2761-4b0a-a347-7134cec00d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:39.403630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1283/2582] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:39 2022] DELETE /identity/v3/projects/5ba6d1693d0245d889da0fc0a80f9f5f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:39.408894 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.409440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.409440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.429624 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:39.430830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:39.489737 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1300/2583] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:39.497736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.498022 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.498330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.518582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:39.520418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:39.528451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1284/2584] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:39.532876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.542783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de6c65-fd48-4eab-a843-eccdeba7832b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.547363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.547952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.548259 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.548527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.549164 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:26:39.549461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.551557 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:39.562911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1301/2585] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:26:39.567767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.577062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7416f9-a636-4acb-9655-3b1f4fc76a22 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.581720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.586319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.586319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.586319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.586319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.586319 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:39.739086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1285/2586] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:26:39 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:39.743339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.754195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5321f29-840c-451e-9f38-74e34999f0da admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.815162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.815794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.816648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.816917 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.817560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.819473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:39.894425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1302/2587] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:26:39 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:26:39.896025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.906815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe6017-1935-4d85-a16a-2c78366d293c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.912355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.912950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.917480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.917480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.917480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.917480 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:39.926659 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1286/2588] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:39.930800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.941809 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881ff33-6c0f-4dd8-9cd8-26cbc15da16f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.946438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a41333-4c06-4944-8230-d72fddae2576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.947033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41333-4c06-4944-8230-d72fddae2576 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.947307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41333-4c06-4944-8230-d72fddae2576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.947575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a41333-4c06-4944-8230-d72fddae2576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.948258 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41333-4c06-4944-8230-d72fddae2576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.949839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a41333-4c06-4944-8230-d72fddae2576 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:39.960403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1303/2589] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:26:39.964536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:39.975051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d2797-64f6-4ef2-96a2-bd4a92474c90 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:39.980198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:39.980841 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:39.981117 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:39.981389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] PATH_INFO: `/v3/projects/0ae52cc625b44b7287203bd291b16565/users/c157a60b4b824c7a8cd87b1da35f5a88/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:39.996670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ae52cc625b44b7287203bd291b16565, user_id=c157a60b4b824c7a8cd87b1da35f5a88, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:39.999331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.068846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1287/2590] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:39 2022] PUT /identity/v3/projects/0ae52cc625b44b7287203bd291b16565/users/c157a60b4b824c7a8cd87b1da35f5a88/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:40.081080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.081080 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.081467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.111998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] MFA Rules not processed for user `c157a60b4b824c7a8cd87b1da35f5a88`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:40.113887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:40.146132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:40.180536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1304/2591] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:40.185052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.253994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092015d4-e0d6-4d35-a4d6-334ee75bccd3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.258675 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.259282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.259558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.259827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.260496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:40.262382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.349496 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1288/2592] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:26:40 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:26:40.350817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.362214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728600f1-b143-4ce6-8eef-5459933c04d7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.419728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.420382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.420650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.420919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.421545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:40.423467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.516162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1305/2593] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:26:40 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:40.520223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.531339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66722107-31da-413d-b4c4-e0842e6f629e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.537065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.537689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.538023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.538298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.538965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:40.540615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.552149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1289/2594] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:40.556495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.567214 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb0fd-5768-4393-b8d9-e470da6a0742 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.571887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.572564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.572836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.573102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] PATH_INFO: `/v3/projects/943eafe5f612439fb2a0a4beb9ca3f39/users/ca5b88e892ac493381a3748e80aaa847/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.587591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943eafe5f612439fb2a0a4beb9ca3f39, user_id=ca5b88e892ac493381a3748e80aaa847, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:40.590242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.670048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1306/2595] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:40 2022] PUT /identity/v3/projects/943eafe5f612439fb2a0a4beb9ca3f39/users/ca5b88e892ac493381a3748e80aaa847/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:40.674124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.685191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88564c99-98e7-4546-a84f-a908bf6fa0c9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.733053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:40.742460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f43398-3015-4e0a-aad7-1272624a08b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.743082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f43398-3015-4e0a-aad7-1272624a08b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.743353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f43398-3015-4e0a-aad7-1272624a08b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.743618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f43398-3015-4e0a-aad7-1272624a08b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.744283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f43398-3015-4e0a-aad7-1272624a08b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:40.745959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f43398-3015-4e0a-aad7-1272624a08b6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.756483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1290/2596] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:40.760773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.771689 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156cdd0-47aa-489d-9325-089de9c0dd90 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.776405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.777056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.777330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.777606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] PATH_INFO: `/v3/projects/943eafe5f612439fb2a0a4beb9ca3f39/users/ca5b88e892ac493381a3748e80aaa847/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.779531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=943eafe5f612439fb2a0a4beb9ca3f39, user_id=ca5b88e892ac493381a3748e80aaa847, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:40.782457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:40.792491 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1307/2597] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:40 2022] PUT /identity/v3/projects/943eafe5f612439fb2a0a4beb9ca3f39/users/ca5b88e892ac493381a3748e80aaa847/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:40.802462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.802742 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.803014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:40.832361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] MFA Rules not processed for user `ca5b88e892ac493381a3748e80aaa847`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:40.833568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:40.900250 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1291/2598] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:40.912525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:40.914177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:40.979850 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7f27d-ecd7-49fb-a7b5-58e841769fbb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:40.983398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:40.983998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:40.984297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:40.984568 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:41.025974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:41.042233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:41.043702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:41.053554 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1308/2599] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:42.866459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:42.867879 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:42.880503 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad821e-c34a-4bfc-8507-b31ea0f926ea None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:42.884065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1850ce-3f92-4bb7-a574-bba57dab3df8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:42.884682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1850ce-3f92-4bb7-a574-bba57dab3df8 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:42.884960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1850ce-3f92-4bb7-a574-bba57dab3df8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:42.885233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1850ce-3f92-4bb7-a574-bba57dab3df8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:42.894178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1850ce-3f92-4bb7-a574-bba57dab3df8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:42.895600 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1850ce-3f92-4bb7-a574-bba57dab3df8 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:42.905160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1292/2600] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:47.285667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:47.346047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3cf1-6bf1-47a2-b110-5d0bdc25d6a1 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:47.351192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:47.351815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:47.352110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:47.352389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] PATH_INFO: `/v3/users/c157a60b4b824c7a8cd87b1da35f5a88` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:47.353529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c157a60b4b824c7a8cd87b1da35f5a88)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:47.355495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:47.533728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c157a60b4b824c7a8cd87b1da35f5a88'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:47.534388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c157a60b4b824c7a8cd87b1da35f5a88'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:47.541265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c157a60b4b824c7a8cd87b1da35f5a88'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:47.553297 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c157a60b4b824c7a8cd87b1da35f5a88'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:47.553979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c157a60b4b824c7a8cd87b1da35f5a88'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:47.647925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1309/2601] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:47 2022] DELETE /identity/v3/users/c157a60b4b824c7a8cd87b1da35f5a88 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:47.652788 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:47.653272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:47.653379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:47.672932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:47.678677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:47.732932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1293/2602] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:47.742613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:47.743993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:47.806462 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b79d1-2fcf-4235-a22f-50c373fde86f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:47.810490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:47.811237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:47.811546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:47.811921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:47.822726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:47.824333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:47.834518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1310/2603] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:48.369177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:48.370645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:48.383271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb749faa-23a6-4569-a2c8-47759c8c7ff2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:48.388313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:48.388960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:48.389236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:48.389506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] PATH_INFO: `/v3/projects/0ae52cc625b44b7287203bd291b16565` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:48.390688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ae52cc625b44b7287203bd291b16565)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:48.392735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:48.531481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ae52cc625b44b7287203bd291b16565', 'request_id': 'req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:48.538830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ae52cc625b44b7287203bd291b16565', 'request_id': 'req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:48.540828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:48.544947 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ae52cc625b44b7287203bd291b16565', 'request_id': 'req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:48.684688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] The token cache is being invalidate because project 0ae52cc625b44b7287203bd291b16565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:48.697618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:48.697618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:48.697618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1294/2604] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:48 2022] DELETE /identity/v3/projects/0ae52cc625b44b7287203bd291b16565 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:48.697925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:48.697925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:48.701361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd86be2-1523-4f86-ba07-dc2ba731765d service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:48.756732 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:48.757355 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:48.757637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:48.757908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] PATH_INFO: `/v3/users/ca5b88e892ac493381a3748e80aaa847` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:48.759020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5b88e892ac493381a3748e80aaa847)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:48.760966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:49.026772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5b88e892ac493381a3748e80aaa847'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:49.027342 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5b88e892ac493381a3748e80aaa847'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:49.034435 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5b88e892ac493381a3748e80aaa847'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:49.046145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5b88e892ac493381a3748e80aaa847'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:49.046772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-405c0b04-aa7a-4d4c-b99a-2828c46c3991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5b88e892ac493381a3748e80aaa847'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:49.124868 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1311/2605] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:48 2022] DELETE /identity/v3/users/ca5b88e892ac493381a3748e80aaa847 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:49.784060 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:49.785567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:49.799303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd33ebe2-97cd-4f9b-9dff-865b8760e6bb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:49.857785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:49.858412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:49.858691 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:49.858958 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] PATH_INFO: `/v3/projects/943eafe5f612439fb2a0a4beb9ca3f39` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:49.860122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943eafe5f612439fb2a0a4beb9ca3f39)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:49.862098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.034270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943eafe5f612439fb2a0a4beb9ca3f39', 'request_id': 'req-08e337fb-eb6d-4f2d-9327-64e2b89ce844'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:50.040553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943eafe5f612439fb2a0a4beb9ca3f39', 'request_id': 'req-08e337fb-eb6d-4f2d-9327-64e2b89ce844'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:50.046362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943eafe5f612439fb2a0a4beb9ca3f39', 'request_id': 'req-08e337fb-eb6d-4f2d-9327-64e2b89ce844'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:50.143384 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] The token cache is being invalidate because project 943eafe5f612439fb2a0a4beb9ca3f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:26:50.144174 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:50.144813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-08e337fb-eb6d-4f2d-9327-64e2b89ce844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:50.146318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1295/2606] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:49 2022] DELETE /identity/v3/projects/943eafe5f612439fb2a0a4beb9ca3f39 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:26:50.151327 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.151831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.151946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.172285 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:50.173469 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:50.231445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1312/2607] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:50.239320 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.239605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.239880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.259393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:50.260620 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:50.268435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1296/2608] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:50.273169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.282988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3919191-cbca-41c3-b68d-9e92457da354 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.288038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.288650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.288922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.289188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.289849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:26:50.290146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.291746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.303132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1313/2609] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 07 13:26:50.307321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.316505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4a6b1-01a7-4c74-b1f0-94e9f4324214 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.321200 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.321791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.322067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.322334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.324455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.324893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.408867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1297/2610] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:26:50 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:50.413493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.423535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c2d37-7b7f-4895-a0c1-a3eb81d99f7f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.428447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:50.479276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.479903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.480201 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.480468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.481091 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.482973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.584696 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1314/2611] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:26:50 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:26:50.588825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.599608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b788f-ab0b-401d-8d55-b4ca37fff458 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.604390 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.605156 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.605436 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.605708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.606350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.607946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.618056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1298/2612] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:50.622053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.632498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac11d5-c569-4bd0-a16a-7868b48fcc43 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.637400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ee22-761e-4812-962c-8894c6e97e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.637999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ee22-761e-4812-962c-8894c6e97e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.638307 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ee22-761e-4812-962c-8894c6e97e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.638604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ee22-761e-4812-962c-8894c6e97e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.639278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974ee22-761e-4812-962c-8894c6e97e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.641078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974ee22-761e-4812-962c-8894c6e97e05 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.652281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1315/2613] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:26:50.656552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.677028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f8424-3553-4e38-8df0-919103a98012 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.677028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.677028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.677028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.677400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] PATH_INFO: `/v3/projects/2b03f707faba4ad895a56e6f95b3d314/users/96bf64e458264618a933b0ca91bc258e/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.689124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b03f707faba4ad895a56e6f95b3d314, user_id=96bf64e458264618a933b0ca91bc258e, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.692300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.760521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1299/2614] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:26:50 2022] PUT /identity/v3/projects/2b03f707faba4ad895a56e6f95b3d314/users/96bf64e458264618a933b0ca91bc258e/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:50.772924 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.773271 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.773548 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.802190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] MFA Rules not processed for user `96bf64e458264618a933b0ca91bc258e`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:50.803384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:50.877054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1316/2615] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:50.888513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:50.890222 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:50.903784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:50.948219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c82751-0591-481a-acb3-bbfa22ffa948 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:50.951884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b3a67-8127-4f53-b207-2e51d54ad3b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:50.952515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3a67-8127-4f53-b207-2e51d54ad3b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:50.952787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3a67-8127-4f53-b207-2e51d54ad3b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:50.953051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3a67-8127-4f53-b207-2e51d54ad3b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:50.961987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b3a67-8127-4f53-b207-2e51d54ad3b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:50.963447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b3a67-8127-4f53-b207-2e51d54ad3b0 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:50.972305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1300/2616] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:58.903651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:58.968717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f2c51-a071-4feb-af53-adc421a6bd1b None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:58.973813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:58.974460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:58.974765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:58.975235 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] PATH_INFO: `/v3/users/96bf64e458264618a933b0ca91bc258e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:58.976408 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bf64e458264618a933b0ca91bc258e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:58.978923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:59.001313 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:26:59.173320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bf64e458264618a933b0ca91bc258e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:59.173984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bf64e458264618a933b0ca91bc258e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:59.181267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bf64e458264618a933b0ca91bc258e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:59.193325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bf64e458264618a933b0ca91bc258e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:59.193952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bf64e458264618a933b0ca91bc258e'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:26:59.280185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1317/2617] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:26:58 2022] DELETE /identity/v3/users/96bf64e458264618a933b0ca91bc258e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:26:59.285065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:59.285537 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:59.285645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:59.305162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:26:59.306378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:59.365171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1301/2618] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:26:59.375010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:59.376549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:59.436509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca44253-d86b-49b3-8cf7-b13c51dd729b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:59.440269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbfcbd-4eee-4c77-8bba-ad5619bfaa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:59.440875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfcbd-4eee-4c77-8bba-ad5619bfaa26 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:59.441147 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfcbd-4eee-4c77-8bba-ad5619bfaa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:59.441412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbfcbd-4eee-4c77-8bba-ad5619bfaa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:59.450275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbfcbd-4eee-4c77-8bba-ad5619bfaa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:59.451561 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbfcbd-4eee-4c77-8bba-ad5619bfaa26 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:59.460727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1318/2619] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:26:59.857921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:26:59.859335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:26:59.873045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed853e-4dea-4c0c-945d-c21c8e73d290 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:26:59.878564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:26:59.879269 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:26:59.879715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:26:59.880115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] PATH_INFO: `/v3/projects/2b03f707faba4ad895a56e6f95b3d314` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:26:59.881313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b03f707faba4ad895a56e6f95b3d314)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:26:59.884732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:26:59.997110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b03f707faba4ad895a56e6f95b3d314', 'request_id': 'req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:27:00.003919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b03f707faba4ad895a56e6f95b3d314', 'request_id': 'req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:27:00.009571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b03f707faba4ad895a56e6f95b3d314', 'request_id': 'req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:27:00.084215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] The token cache is being invalidate because project 2b03f707faba4ad895a56e6f95b3d314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:27:00.084427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:27:00.085039 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8a982e7-6d2f-4728-b9df-dc3e4d964f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:27:00.086566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1302/2620] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:26:59 2022] DELETE /identity/v3/projects/2b03f707faba4ad895a56e6f95b3d314 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:27:00.091589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.092047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.092184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.111286 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:00.112997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:00.170941 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1319/2621] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:00.179279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.179586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.179853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.199126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:00.200350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:00.208100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1303/2622] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:00.212204 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.222320 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4eb22-2bce-4833-b1b6-085b17a47189 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.226787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.227439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.227711 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.227976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.228654 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:27:00.228949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.230526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.242349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1320/2623] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:27:00.246516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.255648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52055a5-197e-4791-a62d-9ce7635d2c46 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.260246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.260832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.261150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.261426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.262049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.263924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.345140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1304/2624] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:27:00 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:27:00.349964 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.360333 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1232af-c10e-4447-b787-b21ca9f982fa admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.385523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:00.418118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.418722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.419067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.419273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.419905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.421852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.543975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1321/2625] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:27:00 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:27:00.548107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.558286 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188da114-bf7c-4ee2-a8a3-dba973788cae admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.562838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.563432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.563708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.563975 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.564645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.566275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.568338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:00.576556 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1305/2626] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:27:00.580438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.590922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a063e8-d606-40db-b2e6-fb96895e47fe admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.595633 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852fb33-b54a-492c-9f70-48efc9782c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.596194 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fb33-b54a-492c-9f70-48efc9782c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.597128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fb33-b54a-492c-9f70-48efc9782c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.597413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852fb33-b54a-492c-9f70-48efc9782c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.598046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852fb33-b54a-492c-9f70-48efc9782c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.599705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852fb33-b54a-492c-9f70-48efc9782c29 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.609497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1322/2627] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:27:00.613718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.623846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a89c50-4d56-4965-9fbb-e2f6fc017a5a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.628815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.629682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.630318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.630664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] PATH_INFO: `/v3/projects/d9505c834a0a4a41a7c40cf72e9d8b31/users/c7ba35aac82f4eb6acb317d70c04eca0/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.645601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9505c834a0a4a41a7c40cf72e9d8b31, user_id=c7ba35aac82f4eb6acb317d70c04eca0, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.648270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.719305 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1306/2628] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:27:00 2022] PUT /identity/v3/projects/d9505c834a0a4a41a7c40cf72e9d8b31/users/c7ba35aac82f4eb6acb317d70c04eca0/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:27:00.725222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a6b0-a85c-412a-8396-952bb44f7b0c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.725534 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a6b0-a85c-412a-8396-952bb44f7b0c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.725805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8a6b0-a85c-412a-8396-952bb44f7b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.744566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-eab8a6b0-a85c-412a-8396-952bb44f7b0c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:00.745763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eab8a6b0-a85c-412a-8396-952bb44f7b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:00.803418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1323/2629] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:00.813229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:00.814892 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:00.870149 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b7171-471d-45cf-9405-5ba934f23223 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:00.873713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:00.874300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:00.874572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:00.874838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:00.883525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:00.884973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:00.895868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1307/2630] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:27:02.196503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca3cd-07e6-451c-aedd-a83879b87ed7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:02.197042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca3cd-07e6-451c-aedd-a83879b87ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:02.197042 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ca3cd-07e6-451c-aedd-a83879b87ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:02.225993 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3b2ca3cd-07e6-451c-aedd-a83879b87ed7 None None] MFA Rules not processed for user `c7ba35aac82f4eb6acb317d70c04eca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:02.227215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3b2ca3cd-07e6-451c-aedd-a83879b87ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:02.298282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1324/2631] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:27:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:02.309284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:02.310707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:02.369527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dace09-86a8-49fa-b27e-c5d24cbf285a service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:02.373130 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a008e-6ff2-4343-87b2-fe2d133f9e8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:02.373735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a008e-6ff2-4343-87b2-fe2d133f9e8d service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:02.374007 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a008e-6ff2-4343-87b2-fe2d133f9e8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:02.374274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a008e-6ff2-4343-87b2-fe2d133f9e8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:02.382545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a008e-6ff2-4343-87b2-fe2d133f9e8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:02.383985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a008e-6ff2-4343-87b2-fe2d133f9e8d service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:02.394298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1308/2632] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:27:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:27:04.135885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b993eed-5ba6-4159-95a2-23c5a9f5fb87 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:04.136440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b993eed-5ba6-4159-95a2-23c5a9f5fb87 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:04.136440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b993eed-5ba6-4159-95a2-23c5a9f5fb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:04.156869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6b993eed-5ba6-4159-95a2-23c5a9f5fb87 None None] MFA Rules not processed for user `c7ba35aac82f4eb6acb317d70c04eca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:04.158322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6b993eed-5ba6-4159-95a2-23c5a9f5fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:04.165104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1325/2633] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:27:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:12.389591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:14.151973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:26.081749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:26.082254 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:26.082364 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:26.111486 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] MFA Rules not processed for user `c7ba35aac82f4eb6acb317d70c04eca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:26.112735 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:26.137857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1309/2634] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:36.135698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=15 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:27:43.778138 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:43.778611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:43.778780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:43.807858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:43.809043 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:43.889225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1326/2635] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:27:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:44.143104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:44.144550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:44.226764 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33383bbd-a36e-405c-944e-49d7381b131b None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:44.233241 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35354c-3aaa-40f1-979d-3aacb1e9d7ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:44.234030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35354c-3aaa-40f1-979d-3aacb1e9d7ae service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:44.234367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35354c-3aaa-40f1-979d-3aacb1e9d7ae service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:44.234731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35354c-3aaa-40f1-979d-3aacb1e9d7ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:44.243987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35354c-3aaa-40f1-979d-3aacb1e9d7ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:44.245745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35354c-3aaa-40f1-979d-3aacb1e9d7ae service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:44.253986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1310/2636] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:27:47.939330 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:47.940827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:48.081609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcebc6-775b-4130-aadc-f59c20b26753 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:48.088282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:48.089036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:48.089319 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:48.089594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:48.091712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:48.106539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:48.108215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:48.119907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1327/2637] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:27:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:27:52.232965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0451f-09b4-4dee-9d6d-76992b13853d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:52.233603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0451f-09b4-4dee-9d6d-76992b13853d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:52.233603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0451f-09b4-4dee-9d6d-76992b13853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:52.259279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-f0b0451f-09b4-4dee-9d6d-76992b13853d None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:27:52.260912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f0b0451f-09b4-4dee-9d6d-76992b13853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:27:52.268500 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1311/2638] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:27:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:27:52.285275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:27:52.301544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220c1b5-fea3-4508-a304-90e18df628a7 service placement] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:27:52.307349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:27:52.308365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:27:52.308944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:27:52.309383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:27:52.319389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:27:52.321026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:27:52.330406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1328/2639] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:27:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:02.252283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=38 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:02.327162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:06.812014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c39740-cbd2-47bb-840d-5f8b69a12a9b None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:06.812589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c39740-cbd2-47bb-840d-5f8b69a12a9b None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:06.812589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c39740-cbd2-47bb-840d-5f8b69a12a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:06.834479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-71c39740-cbd2-47bb-840d-5f8b69a12a9b None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:06.839138 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-71c39740-cbd2-47bb-840d-5f8b69a12a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:06.846037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1312/2640] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:28:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:06.868589 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:06.882136 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac38882-cfc2-4e56-9094-c7126b7adcfd service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:06.887523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:06.888162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:06.888609 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:06.888885 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:06.899504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:06.901584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:06.911884 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1329/2641] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:11.448704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:11.449332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:11.449612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:11.471223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:11.472866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:11.481825 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1313/2642] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 7 13:28:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:11.504402 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:11.517242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b375-be83-4c80-be18-b9be3b8f8dec service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:11.522523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:11.523125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:11.523401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:11.523671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:11.532463 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:11.534081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:11.542642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1330/2643] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:16.559054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:16.592824 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f6e6a-fe48-4344-9328-457e565c81f6 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:16.599706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:16.599706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:16.599706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:16.599706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] PATH_INFO: `/v3/users/c7ba35aac82f4eb6acb317d70c04eca0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:16.600774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ba35aac82f4eb6acb317d70c04eca0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:16.602917 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:16.806460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ba35aac82f4eb6acb317d70c04eca0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:16.807035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ba35aac82f4eb6acb317d70c04eca0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:16.807644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ba35aac82f4eb6acb317d70c04eca0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:16.825920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ba35aac82f4eb6acb317d70c04eca0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:16.838343 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-39365a97-6170-458b-925e-213b58fa3ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ba35aac82f4eb6acb317d70c04eca0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:16.924934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1314/2644] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:28:16 2022] DELETE /identity/v3/users/c7ba35aac82f4eb6acb317d70c04eca0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:17.224476 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:17.245252 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ca962-0e62-48aa-b00c-b56dfc5d5318 service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:17.307473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:17.308440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:17.308821 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:17.309424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] PATH_INFO: `/v3/projects/d9505c834a0a4a41a7c40cf72e9d8b31` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:17.310754 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9505c834a0a4a41a7c40cf72e9d8b31)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:17.312837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:17.409393 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9505c834a0a4a41a7c40cf72e9d8b31', 'request_id': 'req-561a46a6-49b3-4008-a0c9-fb1321d8c272'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:17.417586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9505c834a0a4a41a7c40cf72e9d8b31', 'request_id': 'req-561a46a6-49b3-4008-a0c9-fb1321d8c272'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:17.425775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9505c834a0a4a41a7c40cf72e9d8b31', 'request_id': 'req-561a46a6-49b3-4008-a0c9-fb1321d8c272'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:17.533515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] The token cache is being invalidate because project d9505c834a0a4a41a7c40cf72e9d8b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:28:17.533815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:17.534524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-561a46a6-49b3-4008-a0c9-fb1321d8c272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:17.536056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1331/2645] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:28:17 2022] DELETE /identity/v3/projects/d9505c834a0a4a41a7c40cf72e9d8b31 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:17.541539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:17.543673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:17.543673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:17.606766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:17.608058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:17.671955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1315/2646] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:17.735298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:17.735574 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:17.735830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:17.758089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:17.759338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:17.767536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1332/2647] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:17.772243 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:17.784169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233044dd-2d51-4446-8460-1dcd0334c1b1 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:17.790338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:17.790935 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:17.791213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:17.791481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:17.792161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:28:17.792463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:17.794076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:17.803887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:17.807259 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1316/2648] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:28:17.811525 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:17.820936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d0db-2baa-4b66-8286-3b44be8f82c9 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:17.825620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:17.826212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:17.826493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:17.826764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:17.827438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:17.829396 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:17.921051 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1333/2649] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:28:17 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:28:17.925213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:17.935576 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd51cfa-f04c-48bc-a94b-a9a4c8d120a6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:17.992098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:17.992699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:17.992970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:17.993237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:17.993864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:17.995760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:18.100141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1317/2650] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:28:17 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:28:18.104411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:18.118851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9d676-0cb0-4f95-8231-c882dcfcb854 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:18.123643 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:18.124351 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:18.124625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:18.124895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:18.125542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:18.127230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:18.137958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1334/2651] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:28:18.142252 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:18.153350 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530962a-23c6-4490-8266-d915d24fc86d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:18.158238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ed573-a085-4542-867a-93aed437e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:18.158860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ed573-a085-4542-867a-93aed437e699 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:18.159139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ed573-a085-4542-867a-93aed437e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:18.159407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ed573-a085-4542-867a-93aed437e699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:18.160042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ed573-a085-4542-867a-93aed437e699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:18.161756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ed573-a085-4542-867a-93aed437e699 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:18.172932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1318/2652] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:28:18.176789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:18.186940 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8bf4-7c97-4ff7-89cf-754fe8d129e8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:18.191617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:18.192293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:18.192565 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:18.193328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] PATH_INFO: `/v3/projects/b0ce6a00ecae4eda863c32e41d623d78/users/dfe7e0944c5f4ce4a5606706c1f55ee3/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:18.204675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:18.209349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ce6a00ecae4eda863c32e41d623d78, user_id=dfe7e0944c5f4ce4a5606706c1f55ee3, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:18.212002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:18.274752 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1335/2653] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:28:18 2022] PUT /identity/v3/projects/b0ce6a00ecae4eda863c32e41d623d78/users/dfe7e0944c5f4ce4a5606706c1f55ee3/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:18.285111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689d1f3-81a0-4ade-9694-581c7172f4af None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:18.285392 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689d1f3-81a0-4ade-9694-581c7172f4af None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:18.285666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689d1f3-81a0-4ade-9694-581c7172f4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:18.313762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0689d1f3-81a0-4ade-9694-581c7172f4af None None] MFA Rules not processed for user `dfe7e0944c5f4ce4a5606706c1f55ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:18.314987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0689d1f3-81a0-4ade-9694-581c7172f4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:18.388062 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1319/2654] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:18.398847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:18.400544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:18.479247 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878c43-431d-4ea0-9872-467c1c308c26 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:18.482822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c5930-9593-4fa2-8de8-35e758292826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:18.483419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c5930-9593-4fa2-8de8-35e758292826 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:18.483694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c5930-9593-4fa2-8de8-35e758292826 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:18.483962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c5930-9593-4fa2-8de8-35e758292826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:18.493015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c5930-9593-4fa2-8de8-35e758292826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:18.494430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c5930-9593-4fa2-8de8-35e758292826 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:18.503081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1336/2655] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:28:21.211740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:21.212310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:21.212310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:21.232920 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] MFA Rules not processed for user `dfe7e0944c5f4ce4a5606706c1f55ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:21.234132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:21.241132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1320/2656] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:28:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:28.499162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:29.360205 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:29.360487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:29.360758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:29.381374 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:29.382709 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:29.452761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1337/2657] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 7 13:28:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:29.469696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:29.471978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:29.550716 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:29.563897 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0485-af56-4f6b-85b2-a3de0b89e57d None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:29.569854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:29.570506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:29.570769 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:29.571040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:29.579672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:29.581306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:29.596272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1321/2658] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:36.032382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:36.033807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:36.118386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b60f9-d765-40b5-8943-332954c56e4d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:36.122295 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:36.122931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:36.123206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:36.123477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:36.125429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:36.184177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:36.185522 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a9073-8171-4d22-ba4f-73f6643c0c19 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:36.194279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1338/2659] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:28:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:28:39.676763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:42.445383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:42.449020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:42.614139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325221a5-8b4a-4a74-b436-591a0d95be60 service swift] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:42.620075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:42.620729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:42.621008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:42.621280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:42.623069 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:42.636230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:42.637847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:42.650170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1322/2660] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:28:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:28:44.975067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8b9f2-a5b7-4498-88ee-ec0894d8b5e3 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:44.976077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8b9f2-a5b7-4498-88ee-ec0894d8b5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:44.976218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8b9f2-a5b7-4498-88ee-ec0894d8b5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:44.996595 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0cd8b9f2-a5b7-4498-88ee-ec0894d8b5e3 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:44.997798 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0cd8b9f2-a5b7-4498-88ee-ec0894d8b5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:45.005096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1339/2661] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:28:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:45.026448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:45.037709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c44b3-6fcf-4c77-a262-c5c155f6d03f service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:45.043448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:45.044035 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:45.044365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:45.044614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:45.052335 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:45.053885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:45.062044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1323/2662] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:46.020298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f37f7-83d3-4649-9ee3-585ba81c7e77 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:46.020796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f37f7-83d3-4649-9ee3-585ba81c7e77 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:46.020931 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f37f7-83d3-4649-9ee3-585ba81c7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:46.039903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-c53f37f7-83d3-4649-9ee3-585ba81c7e77 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:46.041119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c53f37f7-83d3-4649-9ee3-585ba81c7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:46.048209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1340/2663] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 7 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:46.061026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:46.072289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63fc1e-ba68-4078-9aba-9a961ee9fe5a service swift] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:46.077369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:46.078018 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:46.078278 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:46.078549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:46.087191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:46.088887 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:46.098362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1324/2664] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:46.823702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05eda-4d9f-4c47-94b3-49d61110391b None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:46.823985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05eda-4d9f-4c47-94b3-49d61110391b None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:46.824279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf05eda-4d9f-4c47-94b3-49d61110391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:46.844406 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cbf05eda-4d9f-4c47-94b3-49d61110391b None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:46.845606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cbf05eda-4d9f-4c47-94b3-49d61110391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:46.853573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1341/2665] 10.222.0.57 () {58 vars in 1009 bytes} [Wed Sep 7 13:28:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:46.865260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:46.875857 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0057a-d796-4cc1-a8c8-2e3f823e5816 service swift] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:46.880931 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:46.881527 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:46.881803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:46.882074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:46.890789 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:46.895602 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:46.902205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1325/2666] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:47.495485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:47.495943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:47.496287 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:47.516526 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] MFA Rules not processed for user `3516227f02da4f1b90b74577c1fe1cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:47.517846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:47.550910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1342/2667] 10.222.0.57 () {58 vars in 967 bytes} [Wed Sep 7 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:47.557901 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:47.559460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:47.569105 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:47.576516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3493e32-c9ed-47c0-98f6-f0c9bd43fc77 service swift] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:47.583292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:47.584036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:47.588845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:47.588845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:47.588845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:47.589151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437a6c9-fbfe-4784-8d62-9917497a1256 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:47.593150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b772e6cbf5f4fecbc91fc058ff29dc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:47.594220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:47.594220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:47.594437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:47.604544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:47.606174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:47.611423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=100 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:47.617489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1343/2668] 10.222.0.57 () {60 vars in 1384 bytes} [Wed Sep 7 13:28:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 07 13:28:47.668894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:47.670334 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5206982-95c9-4e68-958e-c1d6f7139f66 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:47.681331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1326/2669] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:28:50.663377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:50.674227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae40152-843f-4be1-b924-68b79ee80f78 service swift] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:50.678976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:50.679585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:50.679858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:50.680156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] PATH_INFO: `/v3/users/dfe7e0944c5f4ce4a5606706c1f55ee3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:50.681305 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfe7e0944c5f4ce4a5606706c1f55ee3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:50.683540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:50.970520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfe7e0944c5f4ce4a5606706c1f55ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:50.971628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfe7e0944c5f4ce4a5606706c1f55ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:50.982707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfe7e0944c5f4ce4a5606706c1f55ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:51.005635 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfe7e0944c5f4ce4a5606706c1f55ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:51.006974 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfe7e0944c5f4ce4a5606706c1f55ee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:51.112339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1344/2670] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:28:50 2022] DELETE /identity/v3/users/dfe7e0944c5f4ce4a5606706c1f55ee3 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:51.117711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:51.118472 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:51.118948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:51.158561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:28:51.160177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:51.200105 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=100 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:51.263186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1327/2671] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:28:51.279293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:51.281233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:51.357281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179fbc0-7249-4ba4-a5b9-fef47e1d4094 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:51.361014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:51.361590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:51.361863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:51.362129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:51.377004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:51.377004 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:51.384877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1345/2672] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:28:51.898191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:51.900265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:51.912722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611b849-b5b3-47d9-b84b-b19a7230752c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:51.918172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:51.918803 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:51.919082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:51.919355 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] PATH_INFO: `/v3/projects/b0ce6a00ecae4eda863c32e41d623d78` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:51.920679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ce6a00ecae4eda863c32e41d623d78)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:51.922612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:52.060292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ce6a00ecae4eda863c32e41d623d78', 'request_id': 'req-453bb82f-bbc5-48f6-a923-d60f91a038f7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:52.066960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ce6a00ecae4eda863c32e41d623d78', 'request_id': 'req-453bb82f-bbc5-48f6-a923-d60f91a038f7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:52.073363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ce6a00ecae4eda863c32e41d623d78', 'request_id': 'req-453bb82f-bbc5-48f6-a923-d60f91a038f7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:52.142221 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] The token cache is being invalidate because project b0ce6a00ecae4eda863c32e41d623d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:28:52.148124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:52.148124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:52.148124 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1328/2673] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:28:51 2022] DELETE /identity/v3/projects/b0ce6a00ecae4eda863c32e41d623d78 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:55.703851 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:55.705438 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:55.719414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ad856-6fa3-4950-a212-87a64582cb7c service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:55.775386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:55.776019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:55.776328 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:55.776602 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] PATH_INFO: `/v3/users/8ff5d6212ea2438aabb3c47eb37eea78` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:55.777734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff5d6212ea2438aabb3c47eb37eea78)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:55.779648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:55.796049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:55.994800 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff5d6212ea2438aabb3c47eb37eea78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:55.995382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff5d6212ea2438aabb3c47eb37eea78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.002206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff5d6212ea2438aabb3c47eb37eea78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.014403 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff5d6212ea2438aabb3c47eb37eea78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.015030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff5d6212ea2438aabb3c47eb37eea78'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.093193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1346/2674] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:28:55 2022] DELETE /identity/v3/users/8ff5d6212ea2438aabb3c47eb37eea78 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:56.354785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:56.356731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:56.372318 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb82f-bbc5-48f6-a923-d60f91a038f7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:56.399453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:56.400914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:56.435706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:56.436368 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:56.436651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:56.436972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] PATH_INFO: `/v3/projects/2354c87caef24900a2e1b5276df7a6f0` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:56.438158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2354c87caef24900a2e1b5276df7a6f0)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:56.440042 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:56.460262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a125f7-b538-46dc-b601-0adbd92610ee admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:56.463943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:56.464584 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:56.464861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:56.465130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:56.466880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:56.478973 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:56.480427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:56.490024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1347/2675] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:28:56.531689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:56.535372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2354c87caef24900a2e1b5276df7a6f0', 'request_id': 'req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.542358 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2354c87caef24900a2e1b5276df7a6f0', 'request_id': 'req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.548116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2354c87caef24900a2e1b5276df7a6f0', 'request_id': 'req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.628387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] The token cache is being invalidate because project 2354c87caef24900a2e1b5276df7a6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:28:56.628721 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.629574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.631635 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1329/2676] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:28:56 2022] DELETE /identity/v3/projects/2354c87caef24900a2e1b5276df7a6f0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:56.636071 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:56.637739 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:56.655699 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafea1b-c3ab-404b-9354-52c34134b1a7 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:56.717192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:56.718031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:56.718222 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:56.718488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] PATH_INFO: `/v3/users/10876ecf0c9946e891c2217cc6bd6592` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:56.719612 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10876ecf0c9946e891c2217cc6bd6592)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:56.721583 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:56.919788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:28:56.925738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10876ecf0c9946e891c2217cc6bd6592'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.926445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10876ecf0c9946e891c2217cc6bd6592'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.934089 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10876ecf0c9946e891c2217cc6bd6592'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.946191 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10876ecf0c9946e891c2217cc6bd6592'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:56.947116 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10876ecf0c9946e891c2217cc6bd6592'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:57.048560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1348/2677] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:28:56 2022] DELETE /identity/v3/users/10876ecf0c9946e891c2217cc6bd6592 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:28:57.291915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:28:57.293400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:28:57.309629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d3eb-607b-4a27-9d13-16b3fd09a6b0 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:28:57.370801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:28:57.371450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:28:57.371730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:28:57.372005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] PATH_INFO: `/v3/projects/a1b4f82c34e14d83a667d40257ff5ea5` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:28:57.373172 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b4f82c34e14d83a667d40257ff5ea5)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:28:57.375100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:28:57.524421 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b4f82c34e14d83a667d40257ff5ea5', 'request_id': 'req-5cc6f8e1-5799-4d2c-a422-26b870591693'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:57.532952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b4f82c34e14d83a667d40257ff5ea5', 'request_id': 'req-5cc6f8e1-5799-4d2c-a422-26b870591693'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:57.540249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b4f82c34e14d83a667d40257ff5ea5', 'request_id': 'req-5cc6f8e1-5799-4d2c-a422-26b870591693'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:57.636776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] The token cache is being invalidate because project a1b4f82c34e14d83a667d40257ff5ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:28:57.637055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:57.637687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:28:57.640353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1330/2678] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:28:57 2022] DELETE /identity/v3/projects/a1b4f82c34e14d83a667d40257ff5ea5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:00.017560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:00.019101 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:00.033183 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33661265-11ed-4e80-830a-86bd2561884f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:00.090958 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:00.091516 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:00.091788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:00.092075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] PATH_INFO: `/v3/users/c650fb007aad4a42ae13906b127bd6a6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:00.093199 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c650fb007aad4a42ae13906b127bd6a6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:00.095090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:00.269128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c650fb007aad4a42ae13906b127bd6a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:00.269867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c650fb007aad4a42ae13906b127bd6a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:00.277375 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c650fb007aad4a42ae13906b127bd6a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:00.289870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c650fb007aad4a42ae13906b127bd6a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:00.290509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4a35a27f-874f-43a7-bf16-45e57270748f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c650fb007aad4a42ae13906b127bd6a6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:00.369911 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1349/2679] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:29:00 2022] DELETE /identity/v3/users/c650fb007aad4a42ae13906b127bd6a6 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:00.826840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:00.832990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:00.841528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6f8e1-5799-4d2c-a422-26b870591693 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:00.900023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:00.900701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:00.900977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:00.901244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] PATH_INFO: `/v3/projects/2144ce1726b34564921080dfa33ec945` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:00.902371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2144ce1726b34564921080dfa33ec945)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:00.904317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:00.911010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:01.059277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2144ce1726b34564921080dfa33ec945', 'request_id': 'req-79cfeca8-ed79-401f-a5f8-da8779f2276f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:01.065372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2144ce1726b34564921080dfa33ec945', 'request_id': 'req-79cfeca8-ed79-401f-a5f8-da8779f2276f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:01.071306 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2144ce1726b34564921080dfa33ec945', 'request_id': 'req-79cfeca8-ed79-401f-a5f8-da8779f2276f'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:01.175317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] The token cache is being invalidate because project 2144ce1726b34564921080dfa33ec945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:29:01.175533 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:01.176324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-79cfeca8-ed79-401f-a5f8-da8779f2276f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:01.177848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1331/2680] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:29:00 2022] DELETE /identity/v3/projects/2144ce1726b34564921080dfa33ec945 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:01.183386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.183933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.183933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.203405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:01.204627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:01.234728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:01.263484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1350/2681] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:01.271379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cc470-6291-420d-9c29-de6626968a3c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.271656 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cc470-6291-420d-9c29-de6626968a3c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.271924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cc470-6291-420d-9c29-de6626968a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.292054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-139cc470-6291-420d-9c29-de6626968a3c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:01.293267 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-139cc470-6291-420d-9c29-de6626968a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:01.301133 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1332/2682] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:01.305893 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.315317 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0a7fd-4901-4115-949b-e20298a6b474 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:01.320012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:01.320680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.320935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.321217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.321875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:29:01.322135 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:01.323722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:01.337869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1351/2683] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:29:01.347992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cc470-6291-420d-9c29-de6626968a3c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.357933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cc470-6291-420d-9c29-de6626968a3c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:01.362936 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:01.363535 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.363812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.364141 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.364730 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:01.368008 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:01.484722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1333/2684] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:01 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:01.488896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.498919 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae9478-0af5-449d-aab2-e04a37b1533f admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:01.556221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:01.556830 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.557104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.557377 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.557998 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:01.559902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:01.690379 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1352/2685] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:01 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:01.694549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.704832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa81dc-8566-4c5d-ab08-d5564ec50979 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:01.709361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:01.709944 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.710219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.710489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.711681 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:01.713300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:01.723330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1334/2686] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:01.727848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.737818 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f40cb-0e0b-4f5f-9dbd-0ab355a51734 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:01.742369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768388c-8052-4d5c-a5d8-4d3782405af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:01.742959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768388c-8052-4d5c-a5d8-4d3782405af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.743230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768388c-8052-4d5c-a5d8-4d3782405af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.743495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768388c-8052-4d5c-a5d8-4d3782405af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.744144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768388c-8052-4d5c-a5d8-4d3782405af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:01.745708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768388c-8052-4d5c-a5d8-4d3782405af9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:01.755681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1353/2687] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:01.759442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.769374 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a2206-fcc1-4a88-80d8-809ab8df5416 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:01.774378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:01.775013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.775285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.775552 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] PATH_INFO: `/v3/projects/7cce9f6d0df8477692fb31d206db963c/users/2d8c30c44ae04d498da3dfbf8bbec88b/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.790744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cce9f6d0df8477692fb31d206db963c, user_id=2d8c30c44ae04d498da3dfbf8bbec88b, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:01.793442 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:01.861257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1335/2688] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:01 2022] PUT /identity/v3/projects/7cce9f6d0df8477692fb31d206db963c/users/2d8c30c44ae04d498da3dfbf8bbec88b/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:01.867803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a234-e5a3-444c-a5a5-96db3ba1517d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:01.868075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a234-e5a3-444c-a5a5-96db3ba1517d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:01.868376 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8a234-e5a3-444c-a5a5-96db3ba1517d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:01.889716 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-9aa8a234-e5a3-444c-a5a5-96db3ba1517d None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:01.890914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-9aa8a234-e5a3-444c-a5a5-96db3ba1517d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:01.950501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1354/2689] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:01.960163 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:01.962453 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:02.020444 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe49b43-e5d6-47f3-8007-9ce53c1ba214 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:02.024630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:02.025895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:02.026755 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:02.027027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:02.036021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:02.037579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:02.047616 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1336/2690] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:07.416349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540ac0e-bcfb-449a-b14a-12d7047cff04 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:07.416824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540ac0e-bcfb-449a-b14a-12d7047cff04 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:07.417036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540ac0e-bcfb-449a-b14a-12d7047cff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:07.454083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d540ac0e-bcfb-449a-b14a-12d7047cff04 None None] MFA Rules not processed for user `2d8c30c44ae04d498da3dfbf8bbec88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:07.455487 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d540ac0e-bcfb-449a-b14a-12d7047cff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:07.489501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:07.525046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1355/2691] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:07.542168 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:07.543593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:07.580219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:07.617446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4464-760d-46dd-be42-a29f26fe7397 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:07.623219 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:07.623966 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:07.624310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:07.624584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:07.634207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:07.636014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:07.650164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1337/2692] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:10.255513 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:10.256056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:10.256056 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:10.276414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] MFA Rules not processed for user `2d8c30c44ae04d498da3dfbf8bbec88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:10.277650 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:10.285119 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1356/2693] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:17.947128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=19 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:20.270841 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=16 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:22.823148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:22.824609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:22.836603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1956-7cf8-4191-a7bc-f6d13d0c01e4 service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:22.840235 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:22.840821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:22.841092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:22.841362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:22.843002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:22.856435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:22.857845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:22.868718 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1338/2694] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:25.218688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:25.229137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd35db7-f772-4029-ace8-83ca948e74ca None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:25.232927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:25.233755 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:25.234035 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:25.234385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:25.236151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:25.250121 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:25.251618 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:25.262549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1357/2695] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:32.863816 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=6 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:35.257743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:38.305700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:38.314733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977fa94-d877-45f8-9ff8-a7f8fdeae876 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:38.318354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:38.318940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:38.319244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:38.319545 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:38.321229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:38.333371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:38.334795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:38.348968 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1339/2696] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:42.033276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:42.034734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:42.048345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce5da-1887-445d-b566-218e76b88c32 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:42.052910 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:42.053545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:42.053822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:42.054090 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] PATH_INFO: `/v3/users/cb3e13c85e8545afab44389368eb91dd` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:42.068394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3e13c85e8545afab44389368eb91dd)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:42.070316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:42.214098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3e13c85e8545afab44389368eb91dd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.214751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3e13c85e8545afab44389368eb91dd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.221620 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3e13c85e8545afab44389368eb91dd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.233744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3e13c85e8545afab44389368eb91dd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.234444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-de351205-2ec5-480f-8325-9d79ee1307e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3e13c85e8545afab44389368eb91dd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.300007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1358/2697] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:29:42 2022] DELETE /identity/v3/users/cb3e13c85e8545afab44389368eb91dd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:42.560226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:42.572586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc5f0-e641-4f72-869a-d5dae12bab5c service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:42.633010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:42.633631 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:42.633908 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:42.634178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] PATH_INFO: `/v3/projects/44b7084e807a4fde9f07303179599b96` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:42.645808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b7084e807a4fde9f07303179599b96)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:42.647956 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:42.747566 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b7084e807a4fde9f07303179599b96', 'request_id': 'req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.754203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b7084e807a4fde9f07303179599b96', 'request_id': 'req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.759815 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b7084e807a4fde9f07303179599b96', 'request_id': 'req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.841134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] The token cache is being invalidate because project 44b7084e807a4fde9f07303179599b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:29:42.841352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.841988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-5b879fdd-1187-4e7a-9e89-b3c6e84de7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:42.843489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1340/2698] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:29:42 2022] DELETE /identity/v3/projects/44b7084e807a4fde9f07303179599b96 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:29:42.848460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:42.853764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:42.853764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:42.869015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:42.870220 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:42.930372 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1359/2699] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:42.938739 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:42.939067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:42.939454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:42.959223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:42.960438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:42.968798 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1341/2700] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:42.972897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:42.983115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ed5ac-e225-4d37-a498-558b06e1738c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:42.987656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:42.988292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:42.988569 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:42.988839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:42.989481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:29:42.989780 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:42.991369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.002670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1360/2701] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:29:43.006921 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:43.016663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce13109-78d7-4078-acf1-08bd8a063cbb None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:43.021290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:43.021876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.022153 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.022419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.023045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:43.025610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.122551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1342/2702] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:43 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:43.126883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:43.137450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3891087-6420-4c7a-b88c-9f562fd11157 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:43.181708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:43.193149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:43.193774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.194054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.198226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.198226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:43.198226 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.280888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1361/2703] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:43 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:43.283965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:43.294489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ad237-e6f9-4532-9df6-188088de9568 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:43.299224 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:43.299822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.300125 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.300399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.301037 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:43.302634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.314542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1343/2704] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:43.318741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:43.329877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a383d78-9c19-4c66-bd74-9852a163dbce admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:43.335733 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800e192-b30a-4a3f-876a-8fab9c577d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:43.336443 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800e192-b30a-4a3f-876a-8fab9c577d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.337010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800e192-b30a-4a3f-876a-8fab9c577d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.337290 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800e192-b30a-4a3f-876a-8fab9c577d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.338660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800e192-b30a-4a3f-876a-8fab9c577d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:43.340278 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800e192-b30a-4a3f-876a-8fab9c577d74 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.351479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1362/2705] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:43.355698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:43.365994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e3af7-fd3e-4017-980c-dbf90be3c595 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:43.375056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:43.375056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.375056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.375056 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] PATH_INFO: `/v3/projects/a6607f2202304d26a9639ecea550c88a/users/f8e59c28f958451f8c12b5689d2977df/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.389559 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6607f2202304d26a9639ecea550c88a, user_id=f8e59c28f958451f8c12b5689d2977df, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:43.392218 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.395346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:43.475914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1344/2706] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:43 2022] PUT /identity/v3/projects/a6607f2202304d26a9639ecea550c88a/users/f8e59c28f958451f8c12b5689d2977df/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:43.487663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.491792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.491792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.517832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] MFA Rules not processed for user `f8e59c28f958451f8c12b5689d2977df`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:43.519044 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:43.585387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1363/2707] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:43.596623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:43.598356 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:43.672549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e7641-370a-42f2-8aff-aa364c8bcd78 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:43.678210 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb6d6b-4b42-4604-b5e2-886a2b02770c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:43.678817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb6d6b-4b42-4604-b5e2-886a2b02770c service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:43.679094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb6d6b-4b42-4604-b5e2-886a2b02770c service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:43.679361 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb6d6b-4b42-4604-b5e2-886a2b02770c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:43.687362 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb6d6b-4b42-4604-b5e2-886a2b02770c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:43.688982 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb6d6b-4b42-4604-b5e2-886a2b02770c service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:43.697950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1345/2708] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:46.938578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:46.998163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300e2fa-6de8-4960-97d7-76a9839e4679 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:47.002680 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:47.003304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:47.003579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:47.003847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] PATH_INFO: `/v3/users/f8e59c28f958451f8c12b5689d2977df` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:47.004986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e59c28f958451f8c12b5689d2977df)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:47.006890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:47.251034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e59c28f958451f8c12b5689d2977df'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:47.251652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e59c28f958451f8c12b5689d2977df'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:47.258535 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e59c28f958451f8c12b5689d2977df'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:47.260423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:47.270706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e59c28f958451f8c12b5689d2977df'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:47.271411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e59c28f958451f8c12b5689d2977df'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:47.332118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1364/2709] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:29:46 2022] DELETE /identity/v3/users/f8e59c28f958451f8c12b5689d2977df => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:47.336819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:47.338108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:47.338738 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:47.358092 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:47.359291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:47.416891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1346/2710] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:47.426485 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:47.427935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:47.485291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde1bb-ce67-4a0c-99f4-fedfb4bb4ece admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:47.488928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b987a8-71cc-428f-b940-e43d58f3ca32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:47.489531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b987a8-71cc-428f-b940-e43d58f3ca32 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:47.489807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b987a8-71cc-428f-b940-e43d58f3ca32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:47.490075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b987a8-71cc-428f-b940-e43d58f3ca32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:47.499162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b987a8-71cc-428f-b940-e43d58f3ca32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:47.500617 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b987a8-71cc-428f-b940-e43d58f3ca32 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:47.510493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1365/2711] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:47.914107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:47.915529 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:47.927756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049a6e9-8e9e-4be1-9136-b116613b7a36 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:47.933437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:47.933596 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:47.933869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:47.934238 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] PATH_INFO: `/v3/projects/a6607f2202304d26a9639ecea550c88a` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:47.935246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6607f2202304d26a9639ecea550c88a)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:47.937170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.066767 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6607f2202304d26a9639ecea550c88a', 'request_id': 'req-95a5976c-dc1e-4776-a917-451564fd14e0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:48.073469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6607f2202304d26a9639ecea550c88a', 'request_id': 'req-95a5976c-dc1e-4776-a917-451564fd14e0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:48.078999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6607f2202304d26a9639ecea550c88a', 'request_id': 'req-95a5976c-dc1e-4776-a917-451564fd14e0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:48.140326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] The token cache is being invalidate because project a6607f2202304d26a9639ecea550c88a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:29:48.140593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:48.141223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-95a5976c-dc1e-4776-a917-451564fd14e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:48.142723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1347/2712] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:29:47 2022] DELETE /identity/v3/projects/a6607f2202304d26a9639ecea550c88a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:48.148213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.148746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.148854 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.169224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:48.170427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:48.228302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1366/2713] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:29:48.236469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.236752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.237028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.246086 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:48.257132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:48.258326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:48.267026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1348/2714] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:48.271166 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.280791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc132-ec6d-429e-be32-2e466ea980e8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.288198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.288198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.288198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.288198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.288611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:29:48.288611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.289529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.301498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1367/2715] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:29:48.305954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.316108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3cca-5a1f-46e3-a96e-3dbab27e1062 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.330914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.330914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.330914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.330914 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.331336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.331336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.408683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1349/2716] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:48 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:48.412866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.423399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8927b2e-dadb-4dc9-bf6c-3f7383a9574d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.479325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.479923 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.480233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.480503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.481131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.483026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.494488 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:48.575030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1368/2717] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:48 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:48.579194 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.594484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06694f-5408-42ea-af3f-a02638c596d3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.594876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.595512 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.595782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.596077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.596749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.598359 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.609077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1350/2718] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:48.613053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.623693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79388f9-e7e0-4d1a-8a1b-95e5d3f23d00 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.628436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ef48b-83d9-4a3c-a005-f51d941d63f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.629030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ef48b-83d9-4a3c-a005-f51d941d63f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.629304 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ef48b-83d9-4a3c-a005-f51d941d63f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.629571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ef48b-83d9-4a3c-a005-f51d941d63f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.630208 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ef48b-83d9-4a3c-a005-f51d941d63f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.631898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ef48b-83d9-4a3c-a005-f51d941d63f1 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.643200 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1369/2719] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:48.648899 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.658629 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748eae9-60e6-4c22-872f-3d47ed1eb652 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.663292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.663942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.664264 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.664534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] PATH_INFO: `/v3/projects/db4e018e95fb4250b2e2d971ee0c6acd/users/d18f2d79f6ac4bddac49a1fc2f7d33ab/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.679976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4e018e95fb4250b2e2d971ee0c6acd, user_id=d18f2d79f6ac4bddac49a1fc2f7d33ab, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.682715 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.740415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1351/2720] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:48 2022] PUT /identity/v3/projects/db4e018e95fb4250b2e2d971ee0c6acd/users/d18f2d79f6ac4bddac49a1fc2f7d33ab/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:29:48.750764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.751041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.751309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.778984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] MFA Rules not processed for user `d18f2d79f6ac4bddac49a1fc2f7d33ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:48.780221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:48.842803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1370/2721] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:48.855538 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:48.857347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:48.932203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2ca5-d818-4fd5-b4f6-2bf0ae4f9d39 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:48.937877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed117f79-59e2-465b-8041-4f6aa69838d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:48.938485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117f79-59e2-465b-8041-4f6aa69838d6 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:48.938763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117f79-59e2-465b-8041-4f6aa69838d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:48.939034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed117f79-59e2-465b-8041-4f6aa69838d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:48.947132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed117f79-59e2-465b-8041-4f6aa69838d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:48.948838 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed117f79-59e2-465b-8041-4f6aa69838d6 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:48.957845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1352/2722] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:49.172675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:49.233901 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9083b3-ca1a-4f3a-8293-e12e2b127f4c None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:49.238414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:49.239036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:49.239310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:49.239577 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] PATH_INFO: `/v3/users/d18f2d79f6ac4bddac49a1fc2f7d33ab` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:49.240673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18f2d79f6ac4bddac49a1fc2f7d33ab)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:49.242631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:49.451844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18f2d79f6ac4bddac49a1fc2f7d33ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:49.452514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18f2d79f6ac4bddac49a1fc2f7d33ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:49.459452 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18f2d79f6ac4bddac49a1fc2f7d33ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:49.471730 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18f2d79f6ac4bddac49a1fc2f7d33ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:49.472380 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18f2d79f6ac4bddac49a1fc2f7d33ab'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:49.474869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:49.558010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1371/2723] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:29:49 2022] DELETE /identity/v3/users/d18f2d79f6ac4bddac49a1fc2f7d33ab => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:49.562558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:49.563044 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:49.563165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:49.582526 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:49.586933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:49.641976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1353/2724] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:49.651975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:49.653441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:49.712734 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12622c7-7656-422a-9b8f-9f9dff57ba80 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:49.716279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be68dd3-7ae7-463a-9b28-f3ecd061170a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:49.716887 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68dd3-7ae7-463a-9b28-f3ecd061170a service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:49.717162 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68dd3-7ae7-463a-9b28-f3ecd061170a service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:49.717432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68dd3-7ae7-463a-9b28-f3ecd061170a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:49.726512 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be68dd3-7ae7-463a-9b28-f3ecd061170a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:49.727927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be68dd3-7ae7-463a-9b28-f3ecd061170a service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:49.737480 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1372/2725] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:50.185960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.188052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:50.201204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba15d2-5e03-4631-9550-4dd8c0c23cd9 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:50.206059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:50.207195 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.207476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.207929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] PATH_INFO: `/v3/projects/db4e018e95fb4250b2e2d971ee0c6acd` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.209128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4e018e95fb4250b2e2d971ee0c6acd)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:50.211116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:50.234641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:50.323650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4e018e95fb4250b2e2d971ee0c6acd', 'request_id': 'req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:50.330213 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4e018e95fb4250b2e2d971ee0c6acd', 'request_id': 'req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:50.336727 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4e018e95fb4250b2e2d971ee0c6acd', 'request_id': 'req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:50.429058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] The token cache is being invalidate because project db4e018e95fb4250b2e2d971ee0c6acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:29:50.429371 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:50.430019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-ec2939da-6e7a-4ed4-b5dd-8f4fb83eac3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:50.431517 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1354/2726] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:29:50 2022] DELETE /identity/v3/projects/db4e018e95fb4250b2e2d971ee0c6acd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:29:50.436389 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.436870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.436971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.456217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:50.457414 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:50.516539 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1373/2727] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:50.526045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.526332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.526633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.547471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:50.548702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:50.556963 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1355/2728] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:50.561118 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.570698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870017-4b2b-499e-b68b-cf012ef525e0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:50.575935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:50.576566 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.576838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.577106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.577769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:29:50.578066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:50.579670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:50.591794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1374/2729] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:29:50.605367 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.614704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc9806-fdd8-4466-97fd-ea2f72909323 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:50.619530 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:50.620150 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.620431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.620699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.621336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:50.623273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:50.729104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1356/2730] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:50 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:50.733322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.743291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7679c-6ffc-416a-830c-fb094c6a4012 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:50.798163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:50.798691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.798972 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.799237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.799861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:50.801804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:50.915242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1375/2731] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:50 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:50.919435 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.929832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd033c9c-3553-48a8-8689-1dc354fab852 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:50.935014 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:50.935608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.935889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.936197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.936868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:50.938464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:50.949488 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1357/2732] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:50.953594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.963564 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a48ad-ee99-4a97-9c22-a72e65ead5e8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:50.968232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4743e-299e-4aec-93f2-216538d2415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:50.968814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4743e-299e-4aec-93f2-216538d2415c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:50.969088 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4743e-299e-4aec-93f2-216538d2415c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:50.969352 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4743e-299e-4aec-93f2-216538d2415c admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:50.970017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4743e-299e-4aec-93f2-216538d2415c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:50.971598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4743e-299e-4aec-93f2-216538d2415c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:50.982196 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1376/2733] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:29:50.986327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:50.996759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997f77d-724c-4516-946b-a872a751d99a admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:51.002328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:51.002976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:51.003375 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:51.003875 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] PATH_INFO: `/v3/projects/4ab031b617f447beba73e3643fd703c4/users/b08737458a1146608612fa559f0caa11/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:51.020829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab031b617f447beba73e3643fd703c4, user_id=b08737458a1146608612fa559f0caa11, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:51.023483 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:51.117845 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1358/2734] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:50 2022] PUT /identity/v3/projects/4ab031b617f447beba73e3643fd703c4/users/b08737458a1146608612fa559f0caa11/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:51.123366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac0b8-4e3d-417f-a866-3d779b1796dd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:51.123648 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac0b8-4e3d-417f-a866-3d779b1796dd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:51.123945 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bac0b8-4e3d-417f-a866-3d779b1796dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:51.131277 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:51.144209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-14bac0b8-4e3d-417f-a866-3d779b1796dd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:51.145407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-14bac0b8-4e3d-417f-a866-3d779b1796dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:51.204468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1377/2735] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:51.214201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:51.215967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:51.272733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150cfcf-3724-4eb5-94b2-66a68021020c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:51.276495 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:51.277094 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:51.277369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:51.277636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:51.287090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:51.288567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:51.298784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1359/2736] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:52.519100 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:52.519603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:52.520134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:52.549688 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] MFA Rules not processed for user `b08737458a1146608612fa559f0caa11`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:52.551015 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:52.619347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1378/2737] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:52.623992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:52.633795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4656c-6e4f-44ff-8424-0f30c061a752 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:52.638929 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:52.639523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:52.639811 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:52.640100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:52.640734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:52.642613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:52.757005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1360/2738] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:52 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:52.761832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:52.772745 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6530b-7194-4060-8e1a-24b7cf9ef258 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:52.829918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:52.830528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:52.830804 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:52.831075 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:52.832161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:52.834096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:52.935416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1379/2739] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:52 2022] POST /identity/v3/users => generated 309 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:52.939389 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:52.949755 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159d0a9-b6bc-45a3-90ed-9f3c51cc3edb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:52.954369 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:52.954961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:52.955233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:52.955499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:52.956152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:52.957787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:52.969271 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1361/2740] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:52.973416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:52.984107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31a75b-5964-496e-9e01-4f49583eb669 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:52.988764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:52.989417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:52.989693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:52.989962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] PATH_INFO: `/v3/projects/f6a75a0bad174a88a8c40ba79bee7b0c/users/98442c022fd443faab2424ce57ba6297/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:53.005154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a75a0bad174a88a8c40ba79bee7b0c, user_id=98442c022fd443faab2424ce57ba6297, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:53.007789 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:53.061514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:53.066937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1380/2741] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:52 2022] PUT /identity/v3/projects/f6a75a0bad174a88a8c40ba79bee7b0c/users/98442c022fd443faab2424ce57ba6297/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:53.070928 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:53.081080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b329546-8bcb-4217-a414-4efa04eb5a08 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:53.092786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:53.138176 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96623e3-6e4a-47f2-9fa7-6cc6804f4684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:53.138784 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96623e3-6e4a-47f2-9fa7-6cc6804f4684 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:53.139064 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96623e3-6e4a-47f2-9fa7-6cc6804f4684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:53.139386 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96623e3-6e4a-47f2-9fa7-6cc6804f4684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:53.140020 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96623e3-6e4a-47f2-9fa7-6cc6804f4684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:53.141642 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96623e3-6e4a-47f2-9fa7-6cc6804f4684 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:53.152797 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1362/2742] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:53.156750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:53.167664 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e37e26-c938-4a5a-8f21-67cb2135dc74 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:53.172420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:53.173070 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:53.173345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:53.173615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] PATH_INFO: `/v3/projects/f6a75a0bad174a88a8c40ba79bee7b0c/users/98442c022fd443faab2424ce57ba6297/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:53.175540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a75a0bad174a88a8c40ba79bee7b0c, user_id=98442c022fd443faab2424ce57ba6297, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:53.178206 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:53.188581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1381/2743] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:53 2022] PUT /identity/v3/projects/f6a75a0bad174a88a8c40ba79bee7b0c/users/98442c022fd443faab2424ce57ba6297/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:54.433618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:54.434077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:54.434193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:54.463923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] MFA Rules not processed for user `98442c022fd443faab2424ce57ba6297`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:54.465198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:54.540467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1363/2744] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:55.889024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:55.953382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6265a5-ab7f-47ab-81c3-844cb4d12cdb admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:55.958077 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:55.958765 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:55.959038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:55.959303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] PATH_INFO: `/v3/users/b08737458a1146608612fa559f0caa11` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:55.960436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08737458a1146608612fa559f0caa11)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:55.962338 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:56.191954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08737458a1146608612fa559f0caa11'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.192632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08737458a1146608612fa559f0caa11'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.200224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08737458a1146608612fa559f0caa11'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.211950 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08737458a1146608612fa559f0caa11'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.212605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08737458a1146608612fa559f0caa11'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.299769 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1382/2745] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:29:55 2022] DELETE /identity/v3/users/b08737458a1146608612fa559f0caa11 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:56.594476 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:56.605187 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4ef7a-ec1b-4c11-9e8a-21bfb7e7f686 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:56.664440 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:56.665175 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:56.665525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:56.665868 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] PATH_INFO: `/v3/projects/4ab031b617f447beba73e3643fd703c4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:56.667518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab031b617f447beba73e3643fd703c4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:56.669046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:56.797010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:56.803801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab031b617f447beba73e3643fd703c4', 'request_id': 'req-32fe5def-4bef-448f-b452-ceaf5f4fd327'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.809941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab031b617f447beba73e3643fd703c4', 'request_id': 'req-32fe5def-4bef-448f-b452-ceaf5f4fd327'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.815413 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab031b617f447beba73e3643fd703c4', 'request_id': 'req-32fe5def-4bef-448f-b452-ceaf5f4fd327'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.962708 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] The token cache is being invalidate because project 4ab031b617f447beba73e3643fd703c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:29:56.962999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.963622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:56.965276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1364/2746] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:29:56 2022] DELETE /identity/v3/projects/4ab031b617f447beba73e3643fd703c4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:56.969385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:56.990016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:56.990016 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60adb22-f6cc-497a-a07a-e781ee90f6cd admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:57.041310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:57.041944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:57.042218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:57.042486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] PATH_INFO: `/v3/users/98442c022fd443faab2424ce57ba6297` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:57.043671 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98442c022fd443faab2424ce57ba6297)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:57.045627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:57.050233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:57.290971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98442c022fd443faab2424ce57ba6297'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.291547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98442c022fd443faab2424ce57ba6297'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.298776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98442c022fd443faab2424ce57ba6297'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.311221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98442c022fd443faab2424ce57ba6297'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.312197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-58d1dac6-4f19-4825-9d9d-6816f6274560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98442c022fd443faab2424ce57ba6297'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.420827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1383/2747] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:29:56 2022] DELETE /identity/v3/users/98442c022fd443faab2424ce57ba6297 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:57.651587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:57.655101 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:57.667750 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe5def-4bef-448f-b452-ceaf5f4fd327 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:57.725534 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:57.726148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:57.726347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:57.726618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] PATH_INFO: `/v3/projects/f6a75a0bad174a88a8c40ba79bee7b0c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:57.727740 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a75a0bad174a88a8c40ba79bee7b0c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:57.729689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:57.831023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a75a0bad174a88a8c40ba79bee7b0c', 'request_id': 'req-f2f0395e-6f37-40e7-9d34-5a32ed109810'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.837378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a75a0bad174a88a8c40ba79bee7b0c', 'request_id': 'req-f2f0395e-6f37-40e7-9d34-5a32ed109810'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.843336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a75a0bad174a88a8c40ba79bee7b0c', 'request_id': 'req-f2f0395e-6f37-40e7-9d34-5a32ed109810'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.914395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] The token cache is being invalidate because project f6a75a0bad174a88a8c40ba79bee7b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:29:57.914699 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.915288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-f2f0395e-6f37-40e7-9d34-5a32ed109810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:29:57.916827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1365/2748] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:29:57 2022] DELETE /identity/v3/projects/f6a75a0bad174a88a8c40ba79bee7b0c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:57.922420 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:57.924845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:57.924845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:57.942660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:57.943865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:58.001425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1384/2749] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:58.009265 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.009553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.009826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.031400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:58.032891 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:58.040832 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1366/2750] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:58.044925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.054388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f6e2a-231f-413c-ab5a-fa1f622844bd None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.059036 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.059631 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.059905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.060217 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.060870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:29:58.061256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.062813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.074137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1385/2751] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:29:58.078736 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.087781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39e6a7-123d-4d7e-a610-101ed180055c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.093100 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.093688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.093962 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.094228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.094856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.096783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.168551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1367/2752] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:58 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:58.172897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.182865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183487c-85fa-4b87-b7a1-55bb4887c012 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.238179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.238775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.239059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.239332 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.239961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.241912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.339607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:58.344473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1386/2753] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:58 2022] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:58.348787 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.359393 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d20fd-289d-4995-af44-3e43b33d81ad admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.364027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.364654 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.364932 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.365202 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.365844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.367428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.378270 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1368/2754] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:29:58.382144 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.392662 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e1f06-8317-4566-a6f6-ee69298fe2a5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.397903 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bea6e-d61f-44b5-939f-78d3ae961610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.398502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bea6e-d61f-44b5-939f-78d3ae961610 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.398778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bea6e-d61f-44b5-939f-78d3ae961610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.399078 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bea6e-d61f-44b5-939f-78d3ae961610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.399718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bea6e-d61f-44b5-939f-78d3ae961610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.401341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bea6e-d61f-44b5-939f-78d3ae961610 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.412146 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1387/2755] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:58.416242 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.426473 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e0d02-645b-4d35-8756-1330681c0941 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.431197 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.431863 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.432165 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.432478 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] PATH_INFO: `/v3/projects/567bc0d21a194b16822165792cd36990/users/e01407bef7804b68a610d1e00f915be6/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.447135 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=567bc0d21a194b16822165792cd36990, user_id=e01407bef7804b68a610d1e00f915be6, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.449893 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.452793 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:58.518032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1369/2756] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:58 2022] PUT /identity/v3/projects/567bc0d21a194b16822165792cd36990/users/e01407bef7804b68a610d1e00f915be6/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:58.528501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.528781 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.529053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.557445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] MFA Rules not processed for user `e01407bef7804b68a610d1e00f915be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:58.558652 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:58.624514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1388/2757] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:29:58.629075 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.694186 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f362a-f1db-4b96-a8f5-3b4a4390f2cb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.698910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.699507 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.699781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.700076 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.700726 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.702657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.788162 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1370/2758] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:29:58 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:58.792228 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:58.803453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ac40c-f0a3-4464-af9f-8a3cfa018d50 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:58.858159 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:58.858763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:58.859037 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:58.859303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:58.859928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:58.861873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:58.991840 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1389/2759] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:29:58 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:29:58.995827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:59.006717 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f26c5-847c-4fe5-be2d-d32bbadce3dc admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:59.011549 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:59.012188 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.012497 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.012776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.013419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:59.015028 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:59.025822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1371/2760] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:59.030576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:59.041254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b81dc-37d1-4ee4-8689-bdba3c09773e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:59.046536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:59.047178 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.047447 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.047710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] PATH_INFO: `/v3/projects/3d2ccf0e10a943abacd41843d0afb4c4/users/60313edac7d143f89b4d68b2c82b8818/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.062099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2ccf0e10a943abacd41843d0afb4c4, user_id=60313edac7d143f89b4d68b2c82b8818, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:59.064783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:59.127272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1390/2761] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:59 2022] PUT /identity/v3/projects/3d2ccf0e10a943abacd41843d0afb4c4/users/60313edac7d143f89b4d68b2c82b8818/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:59.131448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:59.141912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f970b6-b251-4b86-9ce7-e30b53d592b3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:59.197731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4ada5-8f4e-41ac-b275-ad033e39d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:59.198337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4ada5-8f4e-41ac-b275-ad033e39d626 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.198615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4ada5-8f4e-41ac-b275-ad033e39d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.198886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4ada5-8f4e-41ac-b275-ad033e39d626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.199519 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4ada5-8f4e-41ac-b275-ad033e39d626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:59.201851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc4ada5-8f4e-41ac-b275-ad033e39d626 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:59.211665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1372/2762] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:29:59.216107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:59.226354 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93775ba-e3f8-4b56-8502-7cd6d94a1841 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:59.231054 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:59.231722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.231996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.232294 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] PATH_INFO: `/v3/projects/3d2ccf0e10a943abacd41843d0afb4c4/users/60313edac7d143f89b4d68b2c82b8818/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.234269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2ccf0e10a943abacd41843d0afb4c4, user_id=60313edac7d143f89b4d68b2c82b8818, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:59.236937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:59.247723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1391/2763] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:29:59 2022] PUT /identity/v3/projects/3d2ccf0e10a943abacd41843d0afb4c4/users/60313edac7d143f89b4d68b2c82b8818/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:29:59.258996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.259276 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.259547 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.287653 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] MFA Rules not processed for user `60313edac7d143f89b4d68b2c82b8818`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:29:59.288888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:59.337994 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:59.356231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1373/2764] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:29:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:29:59.367552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:59.369235 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:29:59.405472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:29:59.428968 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fbfdb-3f2e-4804-89c7-e444298aa69e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:59.432724 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:59.433325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.433600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.433870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.443943 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:59.445788 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:59.455140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1392/2765] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:29:59.667352 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:29:59.678233 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa30490-9b11-4fd1-b99b-179b7d3156ec None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:29:59.681867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350ad0b-68b8-404f-93ec-8c9a51ea0d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:29:59.682506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ad0b-68b8-404f-93ec-8c9a51ea0d04 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:29:59.682801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ad0b-68b8-404f-93ec-8c9a51ea0d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:29:59.685869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ad0b-68b8-404f-93ec-8c9a51ea0d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:29:59.743059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350ad0b-68b8-404f-93ec-8c9a51ea0d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:29:59.744633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350ad0b-68b8-404f-93ec-8c9a51ea0d04 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:29:59.754940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1374/2766] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:29:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:03.411927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:03.483501 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa50666-8975-4644-81d0-d9ce219d5597 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:03.488066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:03.488710 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:03.488982 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:03.489249 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] PATH_INFO: `/v3/users/e01407bef7804b68a610d1e00f915be6` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:03.490346 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01407bef7804b68a610d1e00f915be6)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:03.492282 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:03.678000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01407bef7804b68a610d1e00f915be6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:03.678651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01407bef7804b68a610d1e00f915be6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:03.685499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01407bef7804b68a610d1e00f915be6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:03.697440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01407bef7804b68a610d1e00f915be6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:03.698086 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01407bef7804b68a610d1e00f915be6'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:03.768767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1393/2767] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:30:03 2022] DELETE /identity/v3/users/e01407bef7804b68a610d1e00f915be6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:03.773290 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:03.773751 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:03.773869 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:03.793842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:03.795041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:03.853465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1375/2768] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:03.864102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:03.865573 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:03.927140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbda63-a838-45e7-b8ef-24cc98548781 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:03.930787 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:03.931394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:03.931670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:03.931939 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:03.938842 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:03.941427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:03.942872 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:03.952921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1394/2769] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:04.357016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:04.358655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:04.370983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e5aec-35b5-4f03-bdbd-92890bbc6747 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:04.376328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:04.376961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:04.377756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:04.377756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] PATH_INFO: `/v3/projects/567bc0d21a194b16822165792cd36990` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:04.378641 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567bc0d21a194b16822165792cd36990)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:04.380572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:04.501295 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567bc0d21a194b16822165792cd36990', 'request_id': 'req-a5305379-1781-4fab-b769-aedd93e4ca14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.507452 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567bc0d21a194b16822165792cd36990', 'request_id': 'req-a5305379-1781-4fab-b769-aedd93e4ca14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.513283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567bc0d21a194b16822165792cd36990', 'request_id': 'req-a5305379-1781-4fab-b769-aedd93e4ca14'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.634776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] The token cache is being invalidate because project 567bc0d21a194b16822165792cd36990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:30:04.635059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.635687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.637207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1376/2770] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:30:04 2022] DELETE /identity/v3/projects/567bc0d21a194b16822165792cd36990 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:04.641886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:04.651639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897dd5e-38ab-4581-936e-8da871329b6b service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:04.706875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:04.707508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:04.707782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:04.708049 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] PATH_INFO: `/v3/users/60313edac7d143f89b4d68b2c82b8818` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:04.709197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60313edac7d143f89b4d68b2c82b8818)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:04.711108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:04.914099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60313edac7d143f89b4d68b2c82b8818'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.914741 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60313edac7d143f89b4d68b2c82b8818'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.922668 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60313edac7d143f89b4d68b2c82b8818'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.934524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60313edac7d143f89b4d68b2c82b8818'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:04.935149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2e36c796-52d6-4e57-991c-147f8d3b1d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60313edac7d143f89b4d68b2c82b8818'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:05.025735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1395/2771] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:30:04 2022] DELETE /identity/v3/users/60313edac7d143f89b4d68b2c82b8818 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:05.450613 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:05.452096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:05.466593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5305379-1781-4fab-b769-aedd93e4ca14 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:05.475467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:05.524539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:05.525158 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:05.525428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:05.525693 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] PATH_INFO: `/v3/projects/3d2ccf0e10a943abacd41843d0afb4c4` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:05.526867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2ccf0e10a943abacd41843d0afb4c4)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:05.528783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:05.731049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2ccf0e10a943abacd41843d0afb4c4', 'request_id': 'req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:05.737885 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2ccf0e10a943abacd41843d0afb4c4', 'request_id': 'req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:05.743612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2ccf0e10a943abacd41843d0afb4c4', 'request_id': 'req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:05.882864 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] The token cache is being invalidate because project 3d2ccf0e10a943abacd41843d0afb4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:30:05.883145 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:05.883801 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-13ab23f0-1e9f-40f7-af84-a3dfda4a084e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:05.885347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1377/2772] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:30:05 2022] DELETE /identity/v3/projects/3d2ccf0e10a943abacd41843d0afb4c4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:05.890870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:05.891387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:05.891802 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:05.918076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:05.923594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:05.979466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1396/2773] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:05.988297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:05.988520 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:05.988790 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.008336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:06.009536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:06.017477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1378/2774] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:06.025416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.035719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d335f-aebe-4d91-88cf-fda9162eac64 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.040279 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.040866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.041140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.041404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.042053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:30:06.042337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.043912 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.055880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1397/2775] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:30:06.060204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.069562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8fe0e-0149-424b-9d0f-86d4fd3023a3 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.074292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.078523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.078523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.078523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.078523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.078523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.185494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1379/2776] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:30:06 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:30:06.189629 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.194936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:06.200368 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60461-5221-4157-bcfb-6bdaa2097745 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.256160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.256692 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.257000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.257251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.257863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.259837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.350041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1398/2777] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:30:06 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:30:06.354217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.364671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccf389-0719-44cb-8d96-e0c13474a6fb admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.369344 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.369941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.370215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.370601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.371277 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.372945 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.382894 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1380/2778] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:30:06.386822 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.397060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a969f13-ca4a-4a09-b683-35d97890e47d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.401637 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2fe79-b683-4aa5-9648-d6fc3761339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.402237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2fe79-b683-4aa5-9648-d6fc3761339a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.402507 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2fe79-b683-4aa5-9648-d6fc3761339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.402773 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2fe79-b683-4aa5-9648-d6fc3761339a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.403407 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2fe79-b683-4aa5-9648-d6fc3761339a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.404996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2fe79-b683-4aa5-9648-d6fc3761339a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.415831 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1399/2779] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:30:06.420251 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.429987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784568d-15d1-4571-b44f-d8cec47d80fd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.434543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.435191 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.435464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.435734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] PATH_INFO: `/v3/projects/ef18f1412e9d47a4a2902f4f6b9fc67d/users/003d60b636054ceea67016c5ec343ecd/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.450550 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef18f1412e9d47a4a2902f4f6b9fc67d, user_id=003d60b636054ceea67016c5ec343ecd, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.453760 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.538669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1381/2780] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:30:06 2022] PUT /identity/v3/projects/ef18f1412e9d47a4a2902f4f6b9fc67d/users/003d60b636054ceea67016c5ec343ecd/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:06.549025 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.549343 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.549616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.578184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] MFA Rules not processed for user `003d60b636054ceea67016c5ec343ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:06.579388 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:06.645381 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1400/2781] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:06.656688 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:06.658617 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:06.700382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:06.715586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d14133-495a-4cb6-ab94-ae302b2a8ba9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:06.719333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993e4ba-7578-4db0-ab51-2f92dd26f3ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:06.719925 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993e4ba-7578-4db0-ab51-2f92dd26f3ea service glance] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:06.720231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993e4ba-7578-4db0-ab51-2f92dd26f3ea service glance] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:06.720502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993e4ba-7578-4db0-ab51-2f92dd26f3ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:06.728581 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993e4ba-7578-4db0-ab51-2f92dd26f3ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:06.729998 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993e4ba-7578-4db0-ab51-2f92dd26f3ea service glance] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:06.739106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1382/2782] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:16.642524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:16.791772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=9 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:28.157632 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:28.219115 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8fe6c-2c41-4234-be0f-e011178e4f77 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:28.223640 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:28.224646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:28.224646 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:28.224880 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] PATH_INFO: `/v3/users/003d60b636054ceea67016c5ec343ecd` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:28.225928 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=003d60b636054ceea67016c5ec343ecd)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:28.227844 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:28.385434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003d60b636054ceea67016c5ec343ecd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:28.386123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003d60b636054ceea67016c5ec343ecd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:28.393502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003d60b636054ceea67016c5ec343ecd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:28.405213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003d60b636054ceea67016c5ec343ecd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:28.410045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003d60b636054ceea67016c5ec343ecd'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:28.503213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1401/2783] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:30:28 2022] DELETE /identity/v3/users/003d60b636054ceea67016c5ec343ecd => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:28.507697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:28.508189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:28.508296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:28.527477 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:28.528703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:28.587065 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1383/2784] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:28.597511 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:28.599145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:28.656291 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede28fd-30e6-4c85-bba4-f24837a91a1a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:28.660969 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9623d89-f925-495f-9833-668631ed8bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:28.661590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9623d89-f925-495f-9833-668631ed8bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:28.661863 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9623d89-f925-495f-9833-668631ed8bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:28.662132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9623d89-f925-495f-9833-668631ed8bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:28.671404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9623d89-f925-495f-9833-668631ed8bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:28.672869 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9623d89-f925-495f-9833-668631ed8bc4 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:28.682189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1402/2785] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:29.119407 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.121040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:29.135379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152db1c0-7da0-49b0-9707-b7b193e5d12a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.140354 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.140977 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.141249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.141630 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] PATH_INFO: `/v3/projects/ef18f1412e9d47a4a2902f4f6b9fc67d` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.142737 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef18f1412e9d47a4a2902f4f6b9fc67d)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.147687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.285876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef18f1412e9d47a4a2902f4f6b9fc67d', 'request_id': 'req-3304cbea-9ea5-411a-90f9-383cec022cb7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:29.291855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef18f1412e9d47a4a2902f4f6b9fc67d', 'request_id': 'req-3304cbea-9ea5-411a-90f9-383cec022cb7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:29.297400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef18f1412e9d47a4a2902f4f6b9fc67d', 'request_id': 'req-3304cbea-9ea5-411a-90f9-383cec022cb7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:29.357484 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] The token cache is being invalidate because project ef18f1412e9d47a4a2902f4f6b9fc67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:30:29.357773 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:29.358387 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-3304cbea-9ea5-411a-90f9-383cec022cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:29.359926 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1384/2786] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:30:29 2022] DELETE /identity/v3/projects/ef18f1412e9d47a4a2902f4f6b9fc67d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:29.365154 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.365616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.365717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.385517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:29.386721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:29.403872 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:29.445738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1403/2787] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:29.453428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.453713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.453990 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.474611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:29.478622 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:29.483948 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1385/2788] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:29.488124 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.497451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db907d1-6e97-46f3-b7cf-da22f46710b8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.502012 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.502614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.503083 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.503529 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.504221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:30:29.504878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.506471 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.518255 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1404/2789] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:30:29.522651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.531689 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e2d4-6a57-47b8-8904-33217f2a4994 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.537292 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.537828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.538102 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.538370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.538995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.540927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.624967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1386/2790] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:30:29 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:30:29.629718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.639865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a67be0-c26c-4afa-b4e6-a63d33d26353 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.697815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.698423 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.698698 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.698966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.699586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.701540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.800639 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1405/2791] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:30:29 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:30:29.804684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.815469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02331418-b891-4a50-a215-084c80c9ee4d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.820426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.821016 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.821289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.821557 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.822196 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.823804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.834553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1387/2792] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:30:29.838598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.848625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772a541-6239-4de0-b6ed-5b2559dedbbe admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.853268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7bc5e-e9de-4585-ada1-4b43e66a1b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.853864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7bc5e-e9de-4585-ada1-4b43e66a1b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.854140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7bc5e-e9de-4585-ada1-4b43e66a1b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.854410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7bc5e-e9de-4585-ada1-4b43e66a1b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.855050 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7bc5e-e9de-4585-ada1-4b43e66a1b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.856676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7bc5e-e9de-4585-ada1-4b43e66a1b41 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.867272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1406/2793] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:30:29.871833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:29.882400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e9c95-0d1b-4507-b2af-8797a0ca0d2f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:29.887079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:29.887725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:29.888002 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:29.888304 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] PATH_INFO: `/v3/projects/209cc38a70ac470bba954f504e57c45d/users/4e0a98118fc048d6888a9ec36e5fc6d5/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:29.903754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=209cc38a70ac470bba954f504e57c45d, user_id=4e0a98118fc048d6888a9ec36e5fc6d5, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:29.906450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:29.994983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1388/2794] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:30:29 2022] PUT /identity/v3/projects/209cc38a70ac470bba954f504e57c45d/users/4e0a98118fc048d6888a9ec36e5fc6d5/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:30.006024 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:30.006329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:30.006598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:30.035063 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] MFA Rules not processed for user `4e0a98118fc048d6888a9ec36e5fc6d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:30.036370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:30.099681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1407/2795] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:30:30.112104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:30.113763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:30.135874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:30.171010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d409ac8-aff8-4de9-8ef9-7fd8243fbc9c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:30.175226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5624ae-414b-466e-bd7a-fbfa40d3b797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:30.175826 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5624ae-414b-466e-bd7a-fbfa40d3b797 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:30.176128 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5624ae-414b-466e-bd7a-fbfa40d3b797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:30.176462 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5624ae-414b-466e-bd7a-fbfa40d3b797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:30.184712 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5624ae-414b-466e-bd7a-fbfa40d3b797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:30.186509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5624ae-414b-466e-bd7a-fbfa40d3b797 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:30.196568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1389/2796] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:40.096783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:40.257447 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=17 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:49.027251 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:49.091675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a137ca-930f-48aa-95c9-9ad9f66856d0 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:49.096341 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:49.097045 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:49.097397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:49.097674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] PATH_INFO: `/v3/users/4e0a98118fc048d6888a9ec36e5fc6d5` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:49.099324 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0a98118fc048d6888a9ec36e5fc6d5)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:49.101270 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:49.375653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0a98118fc048d6888a9ec36e5fc6d5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:49.375653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0a98118fc048d6888a9ec36e5fc6d5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:49.380778 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0a98118fc048d6888a9ec36e5fc6d5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:49.392985 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0a98118fc048d6888a9ec36e5fc6d5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:49.394356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0a98118fc048d6888a9ec36e5fc6d5'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:49.488888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1408/2797] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:30:49 2022] DELETE /identity/v3/users/4e0a98118fc048d6888a9ec36e5fc6d5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:49.493995 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:49.494458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:49.494582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:49.514122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:49.515337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:49.579532 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1390/2798] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:30:49.590289 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:49.592450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:49.652293 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825db94-8ad4-49d1-8705-f73fafb99db6 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:49.655963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ab5d2-54d5-484e-904f-8601baf0ec37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:49.656642 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ab5d2-54d5-484e-904f-8601baf0ec37 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:49.656914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ab5d2-54d5-484e-904f-8601baf0ec37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:49.657181 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ab5d2-54d5-484e-904f-8601baf0ec37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:49.667703 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ab5d2-54d5-484e-904f-8601baf0ec37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:49.669152 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ab5d2-54d5-484e-904f-8601baf0ec37 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:49.679229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1409/2799] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:50.182152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:50.183732 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:50.196036 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba68d4-45a8-48ec-b3d0-b815c6dc728c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:50.201079 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:50.201723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.202000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.202326 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] PATH_INFO: `/v3/projects/209cc38a70ac470bba954f504e57c45d` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.203539 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209cc38a70ac470bba954f504e57c45d)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:50.205511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:50.343505 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209cc38a70ac470bba954f504e57c45d', 'request_id': 'req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:50.350443 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209cc38a70ac470bba954f504e57c45d', 'request_id': 'req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:50.356087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209cc38a70ac470bba954f504e57c45d', 'request_id': 'req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:50.415832 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c47543-9d20-4881-aee7-464f082e7414 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.416384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c47543-9d20-4881-aee7-464f082e7414 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.416580 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c47543-9d20-4881-aee7-464f082e7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.437104 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-32c47543-9d20-4881-aee7-464f082e7414 None None] MFA Rules not processed for user `2d8c30c44ae04d498da3dfbf8bbec88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:50.438409 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-32c47543-9d20-4881-aee7-464f082e7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:50.440157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] The token cache is being invalidate because project 209cc38a70ac470bba954f504e57c45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:30:50.440451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:50.441093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-d9f6bfc2-7a75-45fb-b3c9-abd8a9e32925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:50.443244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1391/2800] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:30:50 2022] DELETE /identity/v3/projects/209cc38a70ac470bba954f504e57c45d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:50.448054 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.448370 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.449045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.457018 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:50.467873 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:50.469045 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:50.495957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1410/2801] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:50.532856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1392/2802] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:30:50.597418 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474611-498d-4984-9478-02958c9886f7 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.597700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474611-498d-4984-9478-02958c9886f7 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.597971 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474611-498d-4984-9478-02958c9886f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.622918 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-89474611-498d-4984-9478-02958c9886f7 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:50.624189 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-89474611-498d-4984-9478-02958c9886f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:50.632425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1411/2803] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:50.636670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:50.646564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5835d-2899-4dc2-a272-8e4caaa3d750 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:50.651506 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:50.652225 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.652583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.652949 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.653795 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:30:50.654167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:50.655822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:50.672678 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1393/2804] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:30:50.673797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474611-498d-4984-9478-02958c9886f7 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:50.683817 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474611-498d-4984-9478-02958c9886f7 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:50.688876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:50.689514 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.689790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.690061 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.690729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:50.692701 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:50.821808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:50.823573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:50.837632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:50.853922 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1412/2805] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:30:50 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:30:50.857855 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:50.882111 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a251c-8e98-4ce9-a8e0-8ee516e32a15 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:50.920599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76485a7-fb1d-4923-8e22-2928761550ea admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:50.925363 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:50.926298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.926925 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.927169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.927792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:50.929726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:50.932394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:50.933003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:50.933281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:50.933568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:50.935394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:50.945886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:50.947303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:50.955504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1394/2806] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 07 13:30:51.069790 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1413/2807] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:30:50 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:30:51.074129 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:51.086001 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc548b-422d-40fd-8f8e-724359ac1276 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:51.090989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:51.091720 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:51.092280 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:51.093134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:51.093847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:51.095553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:51.109848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1395/2808] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:30:51.114782 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:51.125134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25acd0-f92a-4169-a6eb-b22ab4eb4ba0 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:51.130540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d699-6f80-4730-8c4f-1d5e36dd709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:51.131213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d699-6f80-4730-8c4f-1d5e36dd709d admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:51.131481 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d699-6f80-4730-8c4f-1d5e36dd709d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:51.131746 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d699-6f80-4730-8c4f-1d5e36dd709d admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:51.132453 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22d699-6f80-4730-8c4f-1d5e36dd709d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:51.134048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22d699-6f80-4730-8c4f-1d5e36dd709d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:51.148132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1414/2809] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:30:51.151733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:51.162983 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362123c-a616-4c94-9114-8b828e447bfa admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:51.167713 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:51.168455 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:51.168666 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:51.168938 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] PATH_INFO: `/v3/projects/1f6b7285dfcf4c9dbcb37bb80978449d/users/de1748747b5f45b297307b6fed8e1f91/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:51.183961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b7285dfcf4c9dbcb37bb80978449d, user_id=de1748747b5f45b297307b6fed8e1f91, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:51.186658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:51.298228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1396/2810] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:30:51 2022] PUT /identity/v3/projects/1f6b7285dfcf4c9dbcb37bb80978449d/users/de1748747b5f45b297307b6fed8e1f91/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:51.308687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:51.308908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:51.309180 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:51.351440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] MFA Rules not processed for user `de1748747b5f45b297307b6fed8e1f91`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:51.352718 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:51.422731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1415/2811] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:51.434182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:51.435974 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:51.493383 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b5ea-38b3-422d-975b-f215e456aed9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:51.497077 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:51.497677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:51.497955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:51.498231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:51.506820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:51.508279 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:51.516896 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1397/2812] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:52.385586 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:52.386954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:52.396866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:52.461975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c1017-1472-4b59-bf09-356cb70fa655 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:52.467246 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:52.467856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:52.468165 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:52.468437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:52.475329 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:52.484268 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:52.485898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820492f-84cd-4c51-bd8b-800db053d17a service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:52.495949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1416/2813] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:56.896542 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:56.945297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:30:56.966116 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667194d7-50f4-4508-bff7-b5586462af39 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:56.970752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:56.971379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:56.971655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:56.979747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] PATH_INFO: `/v3/users/de1748747b5f45b297307b6fed8e1f91` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:56.979747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de1748747b5f45b297307b6fed8e1f91)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:56.979747 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:57.163781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de1748747b5f45b297307b6fed8e1f91'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:57.164558 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de1748747b5f45b297307b6fed8e1f91'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:57.165160 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de1748747b5f45b297307b6fed8e1f91'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:57.172332 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de1748747b5f45b297307b6fed8e1f91'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:57.184523 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de1748747b5f45b297307b6fed8e1f91'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:57.288808 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1398/2814] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:30:56 2022] DELETE /identity/v3/users/de1748747b5f45b297307b6fed8e1f91 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:57.293544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:57.294038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:57.294149 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:57.313040 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:30:57.318839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:57.378223 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1417/2815] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:30:57.388814 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:57.390296 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:57.450148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb5000-4bc8-453e-99a7-e4014e0f86b7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:57.453669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:57.454272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:57.454544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:57.454813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:57.463871 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:57.465324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:57.475155 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1399/2816] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:30:57.956758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:57.958386 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:57.972657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b380743-7352-4fac-a46b-3a0b255f7951 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:57.987009 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:57.987766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:57.988125 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:57.988470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] PATH_INFO: `/v3/projects/1f6b7285dfcf4c9dbcb37bb80978449d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:57.990245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6b7285dfcf4c9dbcb37bb80978449d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:57.992553 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:58.127913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6b7285dfcf4c9dbcb37bb80978449d', 'request_id': 'req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:58.136027 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6b7285dfcf4c9dbcb37bb80978449d', 'request_id': 'req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:58.142167 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6b7285dfcf4c9dbcb37bb80978449d', 'request_id': 'req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:58.243439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] The token cache is being invalidate because project 1f6b7285dfcf4c9dbcb37bb80978449d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:30:58.243738 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:58.244460 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:30:58.246064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1418/2817] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:30:57 2022] DELETE /identity/v3/projects/1f6b7285dfcf4c9dbcb37bb80978449d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:30:59.083521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:30:59.092448 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10518e0a-9497-421f-a155-eeed33c49ede service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:30:59.151345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:30:59.152015 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:30:59.152327 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:30:59.152598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:30:59.154360 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:30:59.165244 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:30:59.166733 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:30:59.176626 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1400/2818] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:30:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:31:00.017524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:31:00.018986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:31:00.048188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:00.110988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69401a-e57d-4111-8e3e-0ca6cc44e27d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:31:00.117596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:31:00.118216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:31:00.118490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:31:00.118813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:31:00.121134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:31:00.136195 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:31:00.137935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e892b61c-7be6-4443-bda0-abfd9c0e8c89 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:31:00.151466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1419/2819] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:31:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:31:05.767647 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:31:05.775709 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:05.783876 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df750-ef20-4580-a055-6dffc71ba16c service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:31:05.790112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:31:05.790756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:31:05.791034 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:31:05.791308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:31:05.793144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:31:05.806658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:31:05.808281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:31:05.819633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1401/2820] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:31:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:31:10.221098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=25 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:31:16.217123 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:32:42.955370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:32:42.961596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:32:42.961596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:32:42.974927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] MFA Rules not processed for user `2d8c30c44ae04d498da3dfbf8bbec88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:32:42.976126 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:32:43.030858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1420/2821] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:32:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:32:53.023992 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=25 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:33:25.249973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:33:25.251621 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:33:25.320363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4b313-9b3b-4b3e-999c-b04b55945234 service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:33:25.325257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:33:25.326396 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:33:25.326702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:33:25.326965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:33:25.328707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:33:25.339951 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:33:25.341548 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:33:25.351216 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1402/2822] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:33:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:33:35.347041 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=32 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:12.738345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:34:12.739735 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:12.755588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4b0b5-e4ca-48b6-b1b2-54deedebbb23 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:34:12.761536 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:34:12.762131 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:34:12.762404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:34:12.762670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:34:12.764364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:12.775150 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:34:12.776775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bf647-9bab-4324-9e44-b08b5076a088 service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:34:12.785763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1421/2823] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:34:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:34:22.781575 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:23.199289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:34:23.200776 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:23.212992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c2f9-e3cd-478b-b2af-55d6043552d3 service placement] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:34:23.216608 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:34:23.217322 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:34:23.217601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:34:23.217881 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:34:23.219586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:23.233464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:34:23.234888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:34:23.247993 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1403/2824] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:34:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:34:29.090542 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:34:29.091039 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:34:29.091148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:34:29.109898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] MFA Rules not processed for user `2d8c30c44ae04d498da3dfbf8bbec88b`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:34:29.111095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:29.118093 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1422/2825] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:34:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:34:29.832658 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:34:29.842458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9759dd-a322-4252-9185-b89ad7b75082 service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:34:29.846728 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:34:29.847330 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:34:29.847606 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:34:29.847877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:34:29.849673 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:29.863487 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:34:29.864955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:34:29.876912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1404/2826] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:34:39.105081 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:39.871347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=12 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:34:45.153267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:34:45.168384 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18792a51-7533-44f6-aae3-1942fe0ba7d1 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:34:45.174334 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:34:45.174935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:34:45.175211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:34:45.175475 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:34:45.177213 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:34:45.190775 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:34:45.192451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:34:45.204676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1423/2827] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:34:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:34:55.199729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=6 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:02.255183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:02.267108 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90df9a0-4ba4-4984-87a8-9bf23c9efabf service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:02.272910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d7cfc07ef940b99652044bc7879601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:02.273509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:02.273786 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:02.274057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:02.283498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:02.286040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:02.298313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1405/2828] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:08.927466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:08.936853 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7863617-3bd6-4a19-8af5-74b95b3c4b4d service nova] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:08.940440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:08.941030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:08.941299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:08.941563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:08.943274 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:09.010007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:09.011436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:09.020955 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1424/2829] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:12.292723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=6 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:12.533514 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:12.545106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c380fe-dbff-4c6c-a17e-521e352824b9 service nova] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:12.550230 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:12.550829 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:12.551107 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:12.551378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:12.553291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:12.565415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:12.568140 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:12.579541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1406/2830] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:12.654860 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:12.656400 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:12.668856 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb62bb-6833-42e6-8f10-003550b90923 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:12.673593 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:12.674225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:12.674499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:12.674772 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] PATH_INFO: `/v3/users/2d8c30c44ae04d498da3dfbf8bbec88b` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:12.675889 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8c30c44ae04d498da3dfbf8bbec88b)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:12.677838 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:12.844706 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8c30c44ae04d498da3dfbf8bbec88b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:12.845298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8c30c44ae04d498da3dfbf8bbec88b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:12.852292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8c30c44ae04d498da3dfbf8bbec88b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:12.864766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8c30c44ae04d498da3dfbf8bbec88b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:12.865413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-89e0542e-9e14-4699-8b6c-5e936bba58da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8c30c44ae04d498da3dfbf8bbec88b'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:12.945426 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1425/2831] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:12 2022] DELETE /identity/v3/users/2d8c30c44ae04d498da3dfbf8bbec88b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:13.169465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:13.181880 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3cd54-24a9-4d39-8308-a608b21bc18e service placement] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:13.239937 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:13.240584 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.240856 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.241122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] PATH_INFO: `/v3/projects/7cce9f6d0df8477692fb31d206db963c` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.242237 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cce9f6d0df8477692fb31d206db963c)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:13.244167 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:13.340501 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cce9f6d0df8477692fb31d206db963c', 'request_id': 'req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:13.349650 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cce9f6d0df8477692fb31d206db963c', 'request_id': 'req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:13.356006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cce9f6d0df8477692fb31d206db963c', 'request_id': 'req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:13.448895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] The token cache is being invalidate because project 7cce9f6d0df8477692fb31d206db963c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:13.449120 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:13.450126 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e3046cb0-c2df-4046-8d1e-65abf3eee9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:13.451671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1407/2832] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:13 2022] DELETE /identity/v3/projects/7cce9f6d0df8477692fb31d206db963c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:13.458098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.458594 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.458902 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.478996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:13.480230 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:13.548023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1426/2833] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:13.557052 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.557339 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.557609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.578609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:13.584585 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:13.590208 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1408/2834] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:13.594497 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:13.604797 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b34de-f8d0-4c0b-a4fb-6e04d66783a8 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:13.609425 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:13.610023 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.619225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.619225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.619225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:36:13.619225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:13.619225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:13.619225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:13.627747 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1427/2835] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:36:13.632324 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:13.641562 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613e02d-b12b-4951-990a-a19b86a36da6 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:13.646725 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:13.647345 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.647668 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.647933 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.648593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:13.650491 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:13.764911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1409/2836] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:13 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:13.769067 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:13.779411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c01a-9169-45ee-9649-45b9be92e1a5 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:13.836547 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:13.837156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.837432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.837702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.838339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:13.840275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:13.943310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1428/2837] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:13 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:13.947398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:13.958302 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c347a-be82-4e35-b1d1-7942d45dad88 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:13.963106 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:13.963701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.963978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.964281 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.964927 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:13.966680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:13.977400 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1410/2838] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:13.981934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:13.992239 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b31ce-190a-46bd-9a34-5ffa76900eb9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:13.996886 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb72be-e159-4ad3-b9ef-458e31d3def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:13.997590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb72be-e159-4ad3-b9ef-458e31d3def2 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:13.997867 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb72be-e159-4ad3-b9ef-458e31d3def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:13.998134 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb72be-e159-4ad3-b9ef-458e31d3def2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:13.998766 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb72be-e159-4ad3-b9ef-458e31d3def2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.000378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb72be-e159-4ad3-b9ef-458e31d3def2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.010673 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1429/2839] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:14.014695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.025888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9520b7-6fa9-4273-9a53-fcc09baf41d4 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.030479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.031121 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.031399 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.031670 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] PATH_INFO: `/v3/projects/43415d4990ea459c8243f8f5b7042745/users/6b6a6adfc9c0400483dc50cce4762b0c/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.046198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43415d4990ea459c8243f8f5b7042745, user_id=6b6a6adfc9c0400483dc50cce4762b0c, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.048919 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.143671 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1411/2840] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:14 2022] PUT /identity/v3/projects/43415d4990ea459c8243f8f5b7042745/users/6b6a6adfc9c0400483dc50cce4762b0c/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:14.154647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.154932 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.155207 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.184493 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] MFA Rules not processed for user `6b6a6adfc9c0400483dc50cce4762b0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:14.185721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:14.250185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1430/2841] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:14.255551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.269199 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:14.318182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f7fc3-0c9f-43c0-8ea3-835c611e9648 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.322852 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.325916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.325916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.325916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.325916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.326607 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.399701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1412/2842] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:14 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:14.403725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.415537 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd272a02-77c2-4742-875d-b591dafb655d None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.470616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.471254 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.471530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.471801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.472473 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.474979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.484102 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:14.585888 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1431/2843] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:14 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:14.589889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.601119 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab729b6-c3fb-4a40-ae58-b6301ddb1410 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.605805 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.606411 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.606683 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.606952 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.607589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.609217 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.620134 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1413/2844] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:36:14.624173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.634168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689b52-ced9-45e7-aded-33cc58a0829b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.638883 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.639520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.639794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.640130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] PATH_INFO: `/v3/projects/9b482c324cb64175bdbe08dc9590ce60/users/4d7451c4829d487e8193ed4334fed890/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.656470 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b482c324cb64175bdbe08dc9590ce60, user_id=4d7451c4829d487e8193ed4334fed890, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.659224 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.750877 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1432/2845] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:14 2022] PUT /identity/v3/projects/9b482c324cb64175bdbe08dc9590ce60/users/4d7451c4829d487e8193ed4334fed890/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:14.755471 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.765469 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2fb3c-a45a-4f59-8d10-33f30704fa11 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.820644 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6948407-c9fa-40f0-a3c8-2bcd85672a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.821240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948407-c9fa-40f0-a3c8-2bcd85672a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.821516 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948407-c9fa-40f0-a3c8-2bcd85672a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.821785 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6948407-c9fa-40f0-a3c8-2bcd85672a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.822412 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6948407-c9fa-40f0-a3c8-2bcd85672a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.823992 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6948407-c9fa-40f0-a3c8-2bcd85672a03 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.834115 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1414/2846] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:14.838316 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.848505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5b53-6f60-4f02-b2f7-dfc920dab02a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:14.853132 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:14.853776 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.854053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.854326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] PATH_INFO: `/v3/projects/9b482c324cb64175bdbe08dc9590ce60/users/4d7451c4829d487e8193ed4334fed890/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.856323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b482c324cb64175bdbe08dc9590ce60, user_id=4d7451c4829d487e8193ed4334fed890, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:14.858934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:14.869267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1433/2847] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:14 2022] PUT /identity/v3/projects/9b482c324cb64175bdbe08dc9590ce60/users/4d7451c4829d487e8193ed4334fed890/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:14.880040 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:14.880363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:14.880634 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:14.910240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] MFA Rules not processed for user `4d7451c4829d487e8193ed4334fed890`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:14.911706 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:14.979137 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1415/2848] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:14.990486 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:14.992211 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:15.049858 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a5a25-f60f-4e25-aaef-007cc114e0c4 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:15.053657 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:15.054265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:15.054543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:15.054814 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:15.063947 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:15.065412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:15.075171 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1434/2849] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:15.273817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:15.283420 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2b468-7df6-41f6-b14c-ffdffea09bd6 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:15.287285 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be7da-c728-4006-addb-2c46dec7e0be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:15.287877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be7da-c728-4006-addb-2c46dec7e0be service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:15.288180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be7da-c728-4006-addb-2c46dec7e0be service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:15.288450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be7da-c728-4006-addb-2c46dec7e0be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:15.293567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:15.346543 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be7da-c728-4006-addb-2c46dec7e0be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:15.347997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be7da-c728-4006-addb-2c46dec7e0be service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:15.357366 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1416/2850] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:23.946356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:24.007760 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cadd1e-debe-4eed-90e2-2b6f570cdbf9 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:24.012298 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:24.012921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:24.013193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:24.013461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] PATH_INFO: `/v3/users/6b6a6adfc9c0400483dc50cce4762b0c` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:24.014571 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6a6adfc9c0400483dc50cce4762b0c)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:24.016505 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:24.225019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6a6adfc9c0400483dc50cce4762b0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:24.225667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6a6adfc9c0400483dc50cce4762b0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:24.232897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6a6adfc9c0400483dc50cce4762b0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:24.234767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:24.245515 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6a6adfc9c0400483dc50cce4762b0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:24.246190 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6a6adfc9c0400483dc50cce4762b0c'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:24.319948 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1435/2851] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:23 2022] DELETE /identity/v3/users/6b6a6adfc9c0400483dc50cce4762b0c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:24.324677 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:24.325181 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:24.325284 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:24.344591 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:24.351013 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:24.403912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1417/2852] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:24.413996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:24.415417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:24.473265 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadbfea-c745-486a-b35d-2e6158835a53 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:24.477417 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:24.478031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:24.478308 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:24.478579 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:24.487600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:24.489066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:24.498994 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1436/2853] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:24.913147 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:24.914663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:24.926940 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a4dd7-7fcf-43b9-b261-e560c114d505 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:24.931615 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:24.932623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:24.932623 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:24.932827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] PATH_INFO: `/v3/projects/43415d4990ea459c8243f8f5b7042745` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:24.934780 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43415d4990ea459c8243f8f5b7042745)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:24.936972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:25.049438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43415d4990ea459c8243f8f5b7042745', 'request_id': 'req-e731a79f-dfef-441e-9c97-e961d0880ce7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.055665 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43415d4990ea459c8243f8f5b7042745', 'request_id': 'req-e731a79f-dfef-441e-9c97-e961d0880ce7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.061226 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43415d4990ea459c8243f8f5b7042745', 'request_id': 'req-e731a79f-dfef-441e-9c97-e961d0880ce7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.155554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] The token cache is being invalidate because project 43415d4990ea459c8243f8f5b7042745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:25.155849 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.156463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.158090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1418/2854] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:24 2022] DELETE /identity/v3/projects/43415d4990ea459c8243f8f5b7042745 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:25.163598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:25.174540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa028-cfed-4f6b-9aeb-6461ff90a393 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:25.236175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:25.236757 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:25.237026 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:25.237292 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] PATH_INFO: `/v3/users/4d7451c4829d487e8193ed4334fed890` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:25.238394 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7451c4829d487e8193ed4334fed890)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:25.240348 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:25.398412 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7451c4829d487e8193ed4334fed890'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.399068 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7451c4829d487e8193ed4334fed890'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.405936 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7451c4829d487e8193ed4334fed890'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.417896 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7451c4829d487e8193ed4334fed890'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.424302 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-734c7a82-5ed5-45b0-88c5-59ca7dac4011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7451c4829d487e8193ed4334fed890'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:25.517552 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:25.523236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1437/2855] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:25 2022] DELETE /identity/v3/users/4d7451c4829d487e8193ed4334fed890 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:36:25.970082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:25.971605 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:25.985831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a79f-dfef-441e-9c97-e961d0880ce7 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.016372 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:26.044090 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.044749 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.045027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.045301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] PATH_INFO: `/v3/projects/9b482c324cb64175bdbe08dc9590ce60` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.046467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b482c324cb64175bdbe08dc9590ce60)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.048427 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:26.177822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b482c324cb64175bdbe08dc9590ce60', 'request_id': 'req-a39b2a78-adbb-4e41-b970-99394beebd52'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:26.183991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b482c324cb64175bdbe08dc9590ce60', 'request_id': 'req-a39b2a78-adbb-4e41-b970-99394beebd52'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:26.189333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b482c324cb64175bdbe08dc9590ce60', 'request_id': 'req-a39b2a78-adbb-4e41-b970-99394beebd52'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:26.281446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] The token cache is being invalidate because project 9b482c324cb64175bdbe08dc9590ce60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:26.281731 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:26.282349 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a39b2a78-adbb-4e41-b970-99394beebd52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:26.283865 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1419/2856] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:25 2022] DELETE /identity/v3/projects/9b482c324cb64175bdbe08dc9590ce60 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:26.288975 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.289518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.289518 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.309459 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:26.310655 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:26.370323 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1438/2857] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:26.378019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.378298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.378567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.398618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:26.399813 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:26.407632 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1420/2858] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:26.411954 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:26.421702 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fcc6d-8fc5-472f-b9fc-72ca057e9687 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.426451 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.427076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.427353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.427621 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.428309 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:36:26.428611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.430694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:26.442046 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1439/2859] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:36:26.446827 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:26.456231 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd7124-6da3-48c7-872f-f9fc13803386 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.461063 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.461745 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.462021 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.462291 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.462916 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.464855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:26.572986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1421/2860] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:26 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:36:26.577087 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:26.587128 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bd44b-1c95-4d1f-8c90-236574a3d4d8 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.643370 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.644000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.644310 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.644585 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.645218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.647130 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:26.796038 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1440/2861] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:26 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:26.799419 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:26.810347 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d6e43-3db7-4c89-bedf-fb70cb4c1791 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.814851 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.815445 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.815729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.815999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.816669 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.818272 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:26.828298 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1422/2862] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:26.832098 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:26.842432 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1502-39c3-4962-90c8-9208d07fd849 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.847008 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad367ccf-9beb-468a-8a6c-5306db59f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.847599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad367ccf-9beb-468a-8a6c-5306db59f829 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.847876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad367ccf-9beb-468a-8a6c-5306db59f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.848175 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad367ccf-9beb-468a-8a6c-5306db59f829 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.848810 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad367ccf-9beb-468a-8a6c-5306db59f829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.850378 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad367ccf-9beb-468a-8a6c-5306db59f829 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:26.861365 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1441/2863] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:26.865328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:26.875833 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de73027-8017-442f-92c0-f2acc749bd65 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:26.880560 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:26.881203 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:26.881481 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:26.881753 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] PATH_INFO: `/v3/projects/67b0dd0070ec4af5b38fc05ab61b5c73/users/c7e7cbca05834034ac5871f87168fe30/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:26.895918 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b0dd0070ec4af5b38fc05ab61b5c73, user_id=c7e7cbca05834034ac5871f87168fe30, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:26.901836 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.048110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1423/2864] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:26 2022] PUT /identity/v3/projects/67b0dd0070ec4af5b38fc05ab61b5c73/users/c7e7cbca05834034ac5871f87168fe30/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:27.059238 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.059523 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.059796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.087415 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] MFA Rules not processed for user `c7e7cbca05834034ac5871f87168fe30`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:27.088649 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:27.141457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:27.151444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1442/2865] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:27.156154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.215381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:27.218923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb54ec-8617-46b0-9a67-c7f9129b8224 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.223680 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.224299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.224573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.224840 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.225467 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:27.227957 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.323494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1424/2866] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:27 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:27.327708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.338713 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ce8dd-05c4-4610-a635-3c7d8a22b396 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.395245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.395852 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.396156 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.396576 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.397064 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:27.399030 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.485847 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1443/2867] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:27 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:27.489954 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.500846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367f7ee-e902-4d86-920e-1b3361e0013c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.505460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.506055 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.506333 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.506603 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.507331 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:27.508985 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.519365 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1425/2868] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:27.527129 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.537383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60768aa2-4d1d-4ab8-a9e6-94e8541037a9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.542762 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.543489 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.543764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.544034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] PATH_INFO: `/v3/projects/15fa98d0e7a94ff783c32b1bbd4eff1e/users/01135c2660a5412c813a45673620ac86/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.559356 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fa98d0e7a94ff783c32b1bbd4eff1e, user_id=01135c2660a5412c813a45673620ac86, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:27.562034 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.675031 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1444/2869] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:27 2022] PUT /identity/v3/projects/15fa98d0e7a94ff783c32b1bbd4eff1e/users/01135c2660a5412c813a45673620ac86/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:27.679583 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.689563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d7b6c-e109-4a97-8d4c-75a857b9a40e admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.750104 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c06a42-60d7-429f-a617-f40ec244c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.750696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06a42-60d7-429f-a617-f40ec244c810 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.750971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06a42-60d7-429f-a617-f40ec244c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.751260 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c06a42-60d7-429f-a617-f40ec244c810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.751895 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06a42-60d7-429f-a617-f40ec244c810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:27.753541 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c06a42-60d7-429f-a617-f40ec244c810 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.763459 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1426/2870] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:27.767743 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.778349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d316-06cb-41e1-82aa-42e2c1d36cb3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.782984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.783628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.783907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.784221 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] PATH_INFO: `/v3/projects/15fa98d0e7a94ff783c32b1bbd4eff1e/users/01135c2660a5412c813a45673620ac86/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.786397 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fa98d0e7a94ff783c32b1bbd4eff1e, user_id=01135c2660a5412c813a45673620ac86, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:27.789596 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:27.799736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1445/2871] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:27 2022] PUT /identity/v3/projects/15fa98d0e7a94ff783c32b1bbd4eff1e/users/01135c2660a5412c813a45673620ac86/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:36:27.814744 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.815027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.815300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.843051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] MFA Rules not processed for user `01135c2660a5412c813a45673620ac86`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:27.844273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:27.911612 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1427/2872] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:27.924937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:27.926690 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:27.984946 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d906291-be49-4717-a06b-1904a173e45b admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:27.988626 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04417bb-e1fb-41dd-9d11-93f3d86f8b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:27.996581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04417bb-e1fb-41dd-9d11-93f3d86f8b66 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:27.996581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04417bb-e1fb-41dd-9d11-93f3d86f8b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:27.996581 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04417bb-e1fb-41dd-9d11-93f3d86f8b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:27.999000 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04417bb-e1fb-41dd-9d11-93f3d86f8b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:28.000404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04417bb-e1fb-41dd-9d11-93f3d86f8b66 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:28.009866 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1446/2873] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:30.734465 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:30.785245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:30.796971 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e320ec0-2769-4a28-a609-e4cf4fb5055c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:30.801705 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:30.802461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:30.802734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:30.802999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] PATH_INFO: `/v3/users/c7e7cbca05834034ac5871f87168fe30` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:30.804212 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e7cbca05834034ac5871f87168fe30)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:30.806791 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:30.959030 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e7cbca05834034ac5871f87168fe30'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:30.959684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e7cbca05834034ac5871f87168fe30'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:30.960321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e7cbca05834034ac5871f87168fe30'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:30.967379 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e7cbca05834034ac5871f87168fe30'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:30.979289 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e7cbca05834034ac5871f87168fe30'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:31.076582 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1428/2874] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:30 2022] DELETE /identity/v3/users/c7e7cbca05834034ac5871f87168fe30 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:31.081215 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:31.081726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:31.081835 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:31.100675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:31.101857 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:31.146058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:31.161792 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1447/2875] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:31.171847 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:31.173337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:31.230586 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04670-de8d-4bd9-9bb2-8c33ba9c202c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:31.234074 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:31.234667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:31.234939 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:31.235205 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:31.243862 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:31.245969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:31.255051 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1429/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:31.672520 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:31.673957 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:31.686588 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf630df-969c-47b8-8071-0fff8af12655 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:31.691527 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:31.692339 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:31.692691 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:31.692996 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] PATH_INFO: `/v3/projects/67b0dd0070ec4af5b38fc05ab61b5c73` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:31.694209 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b0dd0070ec4af5b38fc05ab61b5c73)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:31.696218 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:31.784531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b0dd0070ec4af5b38fc05ab61b5c73', 'request_id': 'req-73aac16f-9dfb-4590-aeca-165d92606c12'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:31.790846 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b0dd0070ec4af5b38fc05ab61b5c73', 'request_id': 'req-73aac16f-9dfb-4590-aeca-165d92606c12'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:31.796892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b0dd0070ec4af5b38fc05ab61b5c73', 'request_id': 'req-73aac16f-9dfb-4590-aeca-165d92606c12'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:31.864823 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] The token cache is being invalidate because project 67b0dd0070ec4af5b38fc05ab61b5c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:31.865108 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:31.865729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:31.867229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1448/2877] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:31 2022] DELETE /identity/v3/projects/67b0dd0070ec4af5b38fc05ab61b5c73 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:31.871821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:31.881679 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fd6d2-dd42-4476-8ed6-e2b3c3b0994f service neutron] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:31.938178 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:31.938804 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:31.939080 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:31.939348 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] PATH_INFO: `/v3/users/01135c2660a5412c813a45673620ac86` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:31.940485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01135c2660a5412c813a45673620ac86)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:31.942446 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:31.957822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:32.175528 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01135c2660a5412c813a45673620ac86'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.176282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01135c2660a5412c813a45673620ac86'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.176866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01135c2660a5412c813a45673620ac86'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.184309 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01135c2660a5412c813a45673620ac86'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.196395 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6f6330f5-c9d5-45a6-96dc-6f6b9e46b318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01135c2660a5412c813a45673620ac86'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.267870 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1430/2878] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:31 2022] DELETE /identity/v3/users/01135c2660a5412c813a45673620ac86 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:32.657504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:32.657504 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:32.673498 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aac16f-9dfb-4590-aeca-165d92606c12 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:32.736303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:32.736980 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:32.737262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:32.737533 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] PATH_INFO: `/v3/projects/15fa98d0e7a94ff783c32b1bbd4eff1e` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:32.738647 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fa98d0e7a94ff783c32b1bbd4eff1e)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:32.740603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:32.841614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fa98d0e7a94ff783c32b1bbd4eff1e', 'request_id': 'req-2c4de910-c438-404f-a7dc-528c95da3dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.847622 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fa98d0e7a94ff783c32b1bbd4eff1e', 'request_id': 'req-2c4de910-c438-404f-a7dc-528c95da3dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.853123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fa98d0e7a94ff783c32b1bbd4eff1e', 'request_id': 'req-2c4de910-c438-404f-a7dc-528c95da3dd0'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.925477 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] The token cache is being invalidate because project 15fa98d0e7a94ff783c32b1bbd4eff1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81819) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:32.925848 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.926592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-2c4de910-c438-404f-a7dc-528c95da3dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:32.928244 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1449/2879] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:32 2022] DELETE /identity/v3/projects/15fa98d0e7a94ff783c32b1bbd4eff1e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:32.934098 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:32.934572 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:32.934692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:32.954025 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:32.955223 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:33.014426 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1431/2880] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:33.022198 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.022484 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.022758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.031058 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:33.044276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:33.045479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:33.053606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1450/2881] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:33.057768 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.067403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071689-4f8c-4971-adf2-9c327cd799d2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.074159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.074159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.074159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.074159 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.074567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81818) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:36:33.074567 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.075636 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.088385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1432/2882] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:36:33.092794 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.102430 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c620b-bd1d-4e6a-afa4-bb92782a2227 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.107667 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.108508 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.108694 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.108970 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.109598 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.111509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.215455 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1451/2883] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:33 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:33.218997 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.229429 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd591d9-768f-42b3-92c6-43a2981acfc6 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.289967 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.290493 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.290772 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.291071 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.291704 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.293649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.396323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1433/2884] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:33 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:33.400611 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.411678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52e140-92c6-4e6e-aa2f-bffef5b1e57e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.416836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.417437 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.417715 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.417988 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.418628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.420256 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.430168 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1452/2885] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:33.434707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.444667 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe12d7-1407-47b5-b9b5-9760cbcaeeb9 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.449301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f8956-010b-4fce-8dfe-0b641cb80b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.449889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f8956-010b-4fce-8dfe-0b641cb80b7e admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.450164 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f8956-010b-4fce-8dfe-0b641cb80b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.450432 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f8956-010b-4fce-8dfe-0b641cb80b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.451066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f8956-010b-4fce-8dfe-0b641cb80b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.452690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f8956-010b-4fce-8dfe-0b641cb80b7e admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.457950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:33.463684 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1434/2886] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:33.467849 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.477999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74adf38-b9a9-40f6-9a0d-b53c0112a0b3 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.483141 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.483770 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.484047 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.484349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] PATH_INFO: `/v3/projects/eaeb0e001046427e9477b6d368edda2d/users/94ee629d7102426a82d405313c59b073/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.499878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaeb0e001046427e9477b6d368edda2d, user_id=94ee629d7102426a82d405313c59b073, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.502610 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.579764 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1453/2887] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:33 2022] PUT /identity/v3/projects/eaeb0e001046427e9477b6d368edda2d/users/94ee629d7102426a82d405313c59b073/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:33.589988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.591595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.591595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.618073 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] MFA Rules not processed for user `94ee629d7102426a82d405313c59b073`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:33.619902 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:33.686978 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1435/2888] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:33.691613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.753413 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67837112-d641-448b-990f-7a30ab19d03a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.758010 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.758605 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.758878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.759148 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.759774 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.761785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:33.873197 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1454/2889] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:33 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:33.877089 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:33.888456 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c1be9-9585-43ed-bd5b-490157818d24 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:33.943297 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:33.943959 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:33.944189 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:33.944458 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:33.945087 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:33.947000 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.048363 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1436/2890] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:33 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:34.052236 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.063140 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94fb1ef-9d2e-4b71-a2ba-b8fc33ea4eec admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.067727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.068353 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.068627 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.068900 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.069532 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.071113 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.082155 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1455/2891] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:34.086136 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.096132 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02accf9-6d95-41bd-b8fc-1dc6f24e851c admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.100909 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9960e8-88d6-48d7-882f-544e36d04657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.101536 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9960e8-88d6-48d7-882f-544e36d04657 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.101812 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9960e8-88d6-48d7-882f-544e36d04657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.102082 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9960e8-88d6-48d7-882f-544e36d04657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.102754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9960e8-88d6-48d7-882f-544e36d04657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.104898 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9960e8-88d6-48d7-882f-544e36d04657 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.114911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1437/2892] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:34.118791 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.129410 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad8c7-3944-4fcd-a269-80438f72ace9 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.134019 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.134723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] REQUEST_METHOD: `PUT` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.135066 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.135340 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] PATH_INFO: `/v3/projects/17835056a1c64b9b88a868016feda867/users/dcd8424a66e64752be5ddec8b535ea46/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.149499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17835056a1c64b9b88a868016feda867, user_id=dcd8424a66e64752be5ddec8b535ea46, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.152177 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.236184 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1456/2893] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:34 2022] PUT /identity/v3/projects/17835056a1c64b9b88a868016feda867/users/dcd8424a66e64752be5ddec8b535ea46/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:34.303006 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.303282 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.303563 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.331171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] MFA Rules not processed for user `dcd8424a66e64752be5ddec8b535ea46`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:34.332388 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:34.401236 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:34.406502 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1438/2894] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:34.411275 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.460875 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:34.474999 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28cb21-7eea-44fb-ac4e-26d17300840d admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.480062 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.480687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.480962 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.481232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] PATH_INFO: `/v3/projects` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.481873 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.483758 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.552550 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1457/2895] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:34 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:34.556627 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.567987 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a117ee0-c68f-449d-a906-da2cd8fd7f57 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.624240 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.624888 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.625193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.625463 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.626097 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.628026 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.733912 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1439/2896] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:34 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:34.737927 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.748767 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec4fc8-6ee0-434c-b95a-9616c5d25780 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.753675 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.754272 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.754545 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.754813 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.755448 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.757106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.767510 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1458/2897] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:36:34.771701 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.781911 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071d087-2e60-48a0-93f8-ad29953d9ffd admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.786800 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.787450 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.787722 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.787988 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] PATH_INFO: `/v3/projects/29f1e346fec64544985ee1058724d838/users/c999f9787c85408b8be39c21c45fcee3/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.802479 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f1e346fec64544985ee1058724d838, user_id=c999f9787c85408b8be39c21c45fcee3, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.805215 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.871171 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1440/2898] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:34 2022] PUT /identity/v3/projects/29f1e346fec64544985ee1058724d838/users/c999f9787c85408b8be39c21c45fcee3/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:34.875074 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.885002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2614b2-60b2-413c-97ec-afedb26d790a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.942660 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abb858-c6af-475f-9f53-b9920b97c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.943176 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abb858-c6af-475f-9f53-b9920b97c67e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.943457 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abb858-c6af-475f-9f53-b9920b97c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.943726 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abb858-c6af-475f-9f53-b9920b97c67e admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.944399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abb858-c6af-475f-9f53-b9920b97c67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.945984 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abb858-c6af-475f-9f53-b9920b97c67e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.955676 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1459/2899] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:34.959844 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:34.971066 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2077d2a-aa90-4668-a9e2-95c673ef5b78 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:34.975672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:34.976376 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:34.976651 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:34.976923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] PATH_INFO: `/v3/projects/29f1e346fec64544985ee1058724d838/users/c999f9787c85408b8be39c21c45fcee3/roles/ea3827124d3f4fa689b3cf4cbe7530e8` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:34.979381 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f1e346fec64544985ee1058724d838, user_id=c999f9787c85408b8be39c21c45fcee3, role_id=ea3827124d3f4fa689b3cf4cbe7530e8)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:34.982059 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:34.991986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1441/2900] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:34 2022] PUT /identity/v3/projects/29f1e346fec64544985ee1058724d838/users/c999f9787c85408b8be39c21c45fcee3/roles/ea3827124d3f4fa689b3cf4cbe7530e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:35.004714 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:35.005003 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:35.005303 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:35.033436 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] MFA Rules not processed for user `c999f9787c85408b8be39c21c45fcee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:35.034641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:35.099949 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1460/2901] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:35.111122 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:35.112831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:35.170050 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6a1f4-da0f-49e1-b8e0-0a5809ae050d admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:35.173782 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:35.174404 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:35.174676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:35.174941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:35.184451 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:35.185883 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:35.195301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1442/2902] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:36.273961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:36.275382 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:36.287538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aaff5-a6da-4e8e-a0b2-e913c5e50b9a None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:36.291076 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:36.291670 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:36.291961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:36.292273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:36.337173 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:36.351897 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:36.353364 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:36.363700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1461/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:41.258185 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:41.267783 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60d91d-3ed8-4403-8660-5fdc63ea72e2 service cinder] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:41.271398 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29716a9-87b6-4511-a6ae-a1c373e2c909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:41.271989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29716a9-87b6-4511-a6ae-a1c373e2c909 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:41.272300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29716a9-87b6-4511-a6ae-a1c373e2c909 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:41.272571 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29716a9-87b6-4511-a6ae-a1c373e2c909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:41.319924 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:41.329144 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29716a9-87b6-4511-a6ae-a1c373e2c909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:41.330564 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29716a9-87b6-4511-a6ae-a1c373e2c909 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:41.339394 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1443/2904] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:45.399837 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:45.463603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed209e-0db6-4c15-922d-40db938543a8 service cinder] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:45.468615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:45.469273 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:45.469549 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:45.469815 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] PATH_INFO: `/v3/users/94ee629d7102426a82d405313c59b073` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:45.470929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ee629d7102426a82d405313c59b073)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:45.473028 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:45.643540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ee629d7102426a82d405313c59b073'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:45.644232 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ee629d7102426a82d405313c59b073'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:45.651225 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ee629d7102426a82d405313c59b073'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:45.664362 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ee629d7102426a82d405313c59b073'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:45.669366 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ee629d7102426a82d405313c59b073'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:45.744751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1462/2905] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:45 2022] DELETE /identity/v3/users/94ee629d7102426a82d405313c59b073 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:45.749337 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:45.749860 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:45.750005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:45.770889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:45.772112 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:45.832047 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1444/2906] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:45.841845 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:45.843796 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:45.908163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13e650-3a09-47ef-bb05-07dc160efe8a admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:45.908163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:45.908163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:45.908163 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:45.908708 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:45.915060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:45.916503 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:45.926499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1463/2907] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:46.547110 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:46.548595 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:46.560842 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a149fe8-4305-4ca5-ad84-fa96372dedeb None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:46.565504 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:46.566146 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:46.566425 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:46.566698 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] PATH_INFO: `/v3/projects/eaeb0e001046427e9477b6d368edda2d` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:46.567821 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaeb0e001046427e9477b6d368edda2d)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:46.569763 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:46.699922 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaeb0e001046427e9477b6d368edda2d', 'request_id': 'req-a8348cc0-95b4-4a38-b030-a23d33fb71b3'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:46.706438 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaeb0e001046427e9477b6d368edda2d', 'request_id': 'req-a8348cc0-95b4-4a38-b030-a23d33fb71b3'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:46.712303 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaeb0e001046427e9477b6d368edda2d', 'request_id': 'req-a8348cc0-95b4-4a38-b030-a23d33fb71b3'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:46.790336 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] The token cache is being invalidate because project eaeb0e001046427e9477b6d368edda2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:46.790986 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:46.791294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:46.792853 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1445/2908] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:46 2022] DELETE /identity/v3/projects/eaeb0e001046427e9477b6d368edda2d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:46.796805 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:46.802725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:46.806495 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f0aca-318b-4ad5-9a2b-d38518973cdf service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:46.868777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:46.869405 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:46.869678 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:46.869944 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] PATH_INFO: `/v3/users/dcd8424a66e64752be5ddec8b535ea46` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:46.871060 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd8424a66e64752be5ddec8b535ea46)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:46.872986 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:47.110385 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd8424a66e64752be5ddec8b535ea46'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.110966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd8424a66e64752be5ddec8b535ea46'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.117861 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd8424a66e64752be5ddec8b535ea46'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.130326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd8424a66e64752be5ddec8b535ea46'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.130966 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd8424a66e64752be5ddec8b535ea46'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.196325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1464/2909] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:46 2022] DELETE /identity/v3/users/dcd8424a66e64752be5ddec8b535ea46 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:47.607183 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:47.608648 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:47.622321 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8348cc0-95b4-4a38-b030-a23d33fb71b3 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:47.681061 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:47.681695 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:47.681973 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:47.682353 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] PATH_INFO: `/v3/projects/17835056a1c64b9b88a868016feda867` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:47.683494 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=17835056a1c64b9b88a868016feda867)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:47.685437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:47.703184 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:47.796403 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17835056a1c64b9b88a868016feda867', 'request_id': 'req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.802820 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17835056a1c64b9b88a868016feda867', 'request_id': 'req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.808380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17835056a1c64b9b88a868016feda867', 'request_id': 'req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.892614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] The token cache is being invalidate because project 17835056a1c64b9b88a868016feda867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:47.892877 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.893492 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:47.894999 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1446/2910] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:47 2022] DELETE /identity/v3/projects/17835056a1c64b9b88a868016feda867 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 07 13:36:47.899106 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:47.900563 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:47.913281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61ba5a-137e-46e9-b01f-da299369356e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:47.969237 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:47.969870 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:47.970151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:47.970419 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] PATH_INFO: `/v3/users/c999f9787c85408b8be39c21c45fcee3` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:47.971528 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c999f9787c85408b8be39c21c45fcee3)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:47.973467 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:48.042468 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:48.130963 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c999f9787c85408b8be39c21c45fcee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.131683 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c999f9787c85408b8be39c21c45fcee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.138638 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c999f9787c85408b8be39c21c45fcee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.151188 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c999f9787c85408b8be39c21c45fcee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.151771 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-68e5284a-1446-4d4e-9410-c129014b6309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c999f9787c85408b8be39c21c45fcee3'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.229921 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1465/2911] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:47 2022] DELETE /identity/v3/users/c999f9787c85408b8be39c21c45fcee3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:48.678415 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:48.680996 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:48.695511 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ec171-1909-41e1-ad72-2a2bf51c97ee admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:48.756553 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:48.757182 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:48.757464 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:48.757734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] PATH_INFO: `/v3/projects/29f1e346fec64544985ee1058724d838` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:48.758854 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f1e346fec64544985ee1058724d838)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:48.760807 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:48.883010 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f1e346fec64544985ee1058724d838', 'request_id': 'req-6caa19b2-aab7-4915-b16d-d5dfae750bc0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.889193 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f1e346fec64544985ee1058724d838', 'request_id': 'req-6caa19b2-aab7-4915-b16d-d5dfae750bc0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.894866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f1e346fec64544985ee1058724d838', 'request_id': 'req-6caa19b2-aab7-4915-b16d-d5dfae750bc0'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.984692 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] The token cache is being invalidate because project 29f1e346fec64544985ee1058724d838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:48.984910 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.985525 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-6caa19b2-aab7-4915-b16d-d5dfae750bc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:48.987072 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1447/2912] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:48 2022] DELETE /identity/v3/projects/29f1e346fec64544985ee1058724d838 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:48.993014 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:48.993578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:48.993578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.013677 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:49.014905 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:49.076761 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1466/2913] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:49.086941 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.087274 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.087625 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.107249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:49.108466 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:49.116457 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1448/2914] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:49.120601 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.131450 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b16833-8d32-4732-bb35-9b86bd59bf44 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.136466 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.137110 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.137387 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.137656 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.138421 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:36:49.138750 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.141161 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.153242 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1467/2915] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:36:49.158257 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.169338 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d44e3-eb8c-4407-bd02-4d018250910c None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.174734 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.175323 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.175598 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.176027 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.176889 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.179038 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.295170 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1449/2916] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:49 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:49.299361 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.309937 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862f216-9b1f-4d32-8b66-73f047496094 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.371160 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.371785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.372059 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.372349 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.373048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.374961 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.442007 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1468/2917] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:49 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:49.446229 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.458609 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c654c1-67e5-4dcf-aad9-e6de8aab7752 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.463288 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.465589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.465589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.465589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.465589 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.466723 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.468649 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:49.477687 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1450/2918] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:49.481712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.493759 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbf428-795f-418f-bd2a-863ab495c29e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.500953 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501cd31-40f7-4436-b682-f95410e0e3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.501607 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501cd31-40f7-4436-b682-f95410e0e3be admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.501879 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501cd31-40f7-4436-b682-f95410e0e3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.502145 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501cd31-40f7-4436-b682-f95410e0e3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.502976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501cd31-40f7-4436-b682-f95410e0e3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.504606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501cd31-40f7-4436-b682-f95410e0e3be admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.515824 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1469/2919] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:36:49.520554 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.531204 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39136a9d-562d-415d-abd7-f9a12357ffe5 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.536580 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.537228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.537544 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.537874 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] PATH_INFO: `/v3/projects/82c4bee21d8c4cdb8620fdd1fd0165e6/users/9579b7fb9d09477586625c3ec4f1a206/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.554198 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c4bee21d8c4cdb8620fdd1fd0165e6, user_id=9579b7fb9d09477586625c3ec4f1a206, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.556965 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.633991 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1451/2920] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:49 2022] PUT /identity/v3/projects/82c4bee21d8c4cdb8620fdd1fd0165e6/users/9579b7fb9d09477586625c3ec4f1a206/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:49.645174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.645458 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.645727 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.665721 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:49.676398 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] MFA Rules not processed for user `9579b7fb9d09477586625c3ec4f1a206`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:49.677864 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:49.742890 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1470/2921] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:49.755078 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.757096 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:49.817169 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329e5b9-633e-490a-96f4-624fc0f19192 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.820754 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce895c-db05-4d96-8935-c20fb6903bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.821351 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce895c-db05-4d96-8935-c20fb6903bcf service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.821624 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce895c-db05-4d96-8935-c20fb6903bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.821907 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce895c-db05-4d96-8935-c20fb6903bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.830058 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce895c-db05-4d96-8935-c20fb6903bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.831482 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce895c-db05-4d96-8935-c20fb6903bcf service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:49.840067 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1452/2922] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:49.862651 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:49.928801 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7c006-47d0-4dac-9be1-04dc2c9c0f00 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:49.933490 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:49.934123 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:49.934401 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:49.934674 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] PATH_INFO: `/v3/users/9579b7fb9d09477586625c3ec4f1a206` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:49.935827 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9579b7fb9d09477586625c3ec4f1a206)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:49.937934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:50.113717 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9579b7fb9d09477586625c3ec4f1a206'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:50.114369 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9579b7fb9d09477586625c3ec4f1a206'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:50.121916 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9579b7fb9d09477586625c3ec4f1a206'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:50.134590 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9579b7fb9d09477586625c3ec4f1a206'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:50.135461 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9579b7fb9d09477586625c3ec4f1a206'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:50.223096 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1471/2923] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:49 2022] DELETE /identity/v3/users/9579b7fb9d09477586625c3ec4f1a206 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:50.228313 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:50.228828 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:50.228942 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:50.248696 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:50.250509 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:50.311618 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1453/2924] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:50.321326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:50.322725 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:50.345543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:50.383281 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb5e9-e2cd-4c54-b1cb-7da5a276fb1e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:50.387756 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6033dce-86e3-4e22-8258-95d2a01c9dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:50.388411 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6033dce-86e3-4e22-8258-95d2a01c9dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:50.388707 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6033dce-86e3-4e22-8258-95d2a01c9dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:50.388976 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6033dce-86e3-4e22-8258-95d2a01c9dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:50.399233 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6033dce-86e3-4e22-8258-95d2a01c9dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:50.400829 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6033dce-86e3-4e22-8258-95d2a01c9dc5 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:50.411723 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1472/2925] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:50.858551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:50.860568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:50.875408 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe59c-08ad-4a8c-8356-c9cd18367ab2 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:50.878513 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:50.879154 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:50.879430 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:50.879774 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] PATH_INFO: `/v3/projects/82c4bee21d8c4cdb8620fdd1fd0165e6` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:50.880904 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c4bee21d8c4cdb8620fdd1fd0165e6)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:50.882866 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.023574 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c4bee21d8c4cdb8620fdd1fd0165e6', 'request_id': 'req-c199bf0f-5171-4bb7-884f-f6638f8211a7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:51.029711 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c4bee21d8c4cdb8620fdd1fd0165e6', 'request_id': 'req-c199bf0f-5171-4bb7-884f-f6638f8211a7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:51.035884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c4bee21d8c4cdb8620fdd1fd0165e6', 'request_id': 'req-c199bf0f-5171-4bb7-884f-f6638f8211a7'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:51.111380 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:51.116275 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] The token cache is being invalidate because project 82c4bee21d8c4cdb8620fdd1fd0165e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:51.116579 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:51.117201 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-c199bf0f-5171-4bb7-884f-f6638f8211a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:51.118762 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1454/2926] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:50 2022] DELETE /identity/v3/projects/82c4bee21d8c4cdb8620fdd1fd0165e6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:51.123729 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.124276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.124434 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.144728 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:51.145935 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:51.208908 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1473/2927] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:51.216382 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411b18-3927-43ff-8e7c-c459face181a None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.216663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411b18-3927-43ff-8e7c-c459face181a None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.216989 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411b18-3927-43ff-8e7c-c459face181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.236950 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-32411b18-3927-43ff-8e7c-c459face181a None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:51.238177 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-32411b18-3927-43ff-8e7c-c459face181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:51.246005 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1455/2928] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:51.250808 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.260777 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0df08-d864-4ae7-b793-33c8d8fcf5ed None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.265506 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.266107 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.266383 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.266653 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.267296 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:36:51.267600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.269445 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.281614 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1474/2929] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:36:51.285601 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411b18-3927-43ff-8e7c-c459face181a None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.295053 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411b18-3927-43ff-8e7c-c459face181a None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.300700 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.301385 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.301663 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.301961 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.302690 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.304819 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.403729 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1456/2930] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:51 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:51.408663 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.419719 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daa4fb-7699-4b21-81a6-14759696ac9c admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.477803 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.478404 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.478681 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.478952 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.479578 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.481560 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.583895 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1475/2931] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:51 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 07 13:36:51.588148 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.598707 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5adb90-9371-4512-bc78-122991052c8b admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.603310 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.603934 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.604308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.604577 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.605246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.606867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.617490 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1457/2932] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:36:51.621280 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.631907 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcab00d-e659-4069-8731-7e38d702ef14 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.636544 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e83e58-ed81-4c04-a8ab-b59429620aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.637137 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83e58-ed81-4c04-a8ab-b59429620aba admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.637416 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83e58-ed81-4c04-a8ab-b59429620aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.637686 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e83e58-ed81-4c04-a8ab-b59429620aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.638326 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e83e58-ed81-4c04-a8ab-b59429620aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.639913 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e83e58-ed81-4c04-a8ab-b59429620aba admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.650628 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1476/2933] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 07 13:36:51.654522 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.664831 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705051-1480-431d-a3b7-7d3aea2157a8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.669587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.670228 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.670499 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.670766 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] PATH_INFO: `/v3/projects/3911f32639be42d1bff597368a2cc925/users/1d1dafe1212242b99e7e61452bccca6d/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.685697 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3911f32639be42d1bff597368a2cc925, user_id=1d1dafe1212242b99e7e61452bccca6d, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.688946 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:51.789301 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1458/2934] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:51 2022] PUT /identity/v3/projects/3911f32639be42d1bff597368a2cc925/users/1d1dafe1212242b99e7e61452bccca6d/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:51.801017 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.801325 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.801599 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.830712 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] MFA Rules not processed for user `1d1dafe1212242b99e7e61452bccca6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:51.831929 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:51.844616 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:51.903892 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1477/2935] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:51.917032 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:51.918822 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:51.977294 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad3fcb-0b40-4cf4-b088-3523bb3d32f8 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:51.981093 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87529b1-acb7-4a4f-abe9-548eeed7ee91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b143093bf1e4625a24a2e26ce5ba8a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:51.981694 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87529b1-acb7-4a4f-abe9-548eeed7ee91 service cinder] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:51.981969 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87529b1-acb7-4a4f-abe9-548eeed7ee91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:51.982246 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87529b1-acb7-4a4f-abe9-548eeed7ee91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:51.992850 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87529b1-acb7-4a4f-abe9-548eeed7ee91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:51.994328 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87529b1-acb7-4a4f-abe9-548eeed7ee91 service cinder] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:52.003703 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1459/2936] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:52.026229 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:52.087997 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d09e1-ebcd-4564-8b06-982d2dbe1b57 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:52.092531 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:52.093641 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:52.093904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:52.094169 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] PATH_INFO: `/v3/users/1d1dafe1212242b99e7e61452bccca6d` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:52.095269 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d1dafe1212242b99e7e61452bccca6d)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:52.097185 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:52.255002 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d1dafe1212242b99e7e61452bccca6d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:52.255751 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d1dafe1212242b99e7e61452bccca6d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:52.262399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d1dafe1212242b99e7e61452bccca6d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:52.273960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d1dafe1212242b99e7e61452bccca6d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:52.274615 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d1dafe1212242b99e7e61452bccca6d'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:52.345210 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1478/2937] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:36:52 2022] DELETE /identity/v3/users/1d1dafe1212242b99e7e61452bccca6d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:52.349655 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:52.350157 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:52.350300 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:52.370759 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:52.372003 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:52.433180 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1460/2938] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 07 13:36:52.442959 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:52.444427 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:52.486033 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:52.504603 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70c2f4-0c1d-44ba-83f6-541cd08c96d2 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:52.508592 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d5cdf-b93b-4822-8749-ac0ee7a478fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:52.509267 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5cdf-b93b-4822-8749-ac0ee7a478fc service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:52.509543 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5cdf-b93b-4822-8749-ac0ee7a478fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:52.509836 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d5cdf-b93b-4822-8749-ac0ee7a478fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:52.519496 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d5cdf-b93b-4822-8749-ac0ee7a478fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:52.521530 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d5cdf-b93b-4822-8749-ac0ee7a478fc service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:52.530960 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1479/2939] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:36:52.933152 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:52.935682 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:52.950846 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4be4-7cd4-46cd-9c15-0a20d3628106 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:52.956417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:52.957207 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:52.957489 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:52.957777 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] PATH_INFO: `/v3/projects/3911f32639be42d1bff597368a2cc925` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:52.959068 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3911f32639be42d1bff597368a2cc925)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:52.962253 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.045848 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:53.064378 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3911f32639be42d1bff597368a2cc925', 'request_id': 'req-fde45f0c-066a-452d-90f3-f21560913e49'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:53.070593 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3911f32639be42d1bff597368a2cc925', 'request_id': 'req-fde45f0c-066a-452d-90f3-f21560913e49'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:53.075955 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3911f32639be42d1bff597368a2cc925', 'request_id': 'req-fde45f0c-066a-452d-90f3-f21560913e49'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:53.149878 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] The token cache is being invalidate because project 3911f32639be42d1bff597368a2cc925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:36:53.150263 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:53.150972 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-fde45f0c-066a-452d-90f3-f21560913e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:36:53.152657 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1461/2940] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:36:52 2022] DELETE /identity/v3/projects/3911f32639be42d1bff597368a2cc925 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:53.157613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.157898 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.158174 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.178693 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:53.179914 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:53.241441 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1480/2941] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:53.249161 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.249515 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.249858 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.270283 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:53.271498 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:53.279485 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1462/2942] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:53.284337 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.295179 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65710598-bbdd-41cd-924c-bbce26fc5e04 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:53.299736 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:53.300424 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.300700 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.300967 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] PATH_INFO: `/v3/domains` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.301604 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81819) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 07 13:36:53.301904 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:53.303499 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.315933 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1481/2943] 10.222.0.57 () {58 vars in 1153 bytes} [Wed Sep 7 13:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 07 13:36:53.320273 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.330261 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa2eb8-36c2-4130-9dce-83e554978b36 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:53.335664 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:53.336308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.336587 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.336855 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.337518 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:53.339417 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.427418 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1463/2944] 10.222.0.57 () {60 vars in 1153 bytes} [Wed Sep 7 13:36:53 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:36:53.432151 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.443262 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bc0a7-4665-45bf-b487-d43c7673a60e admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:53.503429 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:53.504192 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.504472 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.504744 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] PATH_INFO: `/v3/users` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.505444 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:53.507345 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.591241 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1482/2945] 10.222.0.57 () {60 vars in 1144 bytes} [Wed Sep 7 13:36:53 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 07 13:36:53.595724 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.606867 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467c324-3442-47ac-91f7-967ce1233a4f admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:53.611454 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:53.612046 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.612346 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.612611 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.613245 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:53.614976 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.625890 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1464/2946] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:53.630053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.641048 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d26b2-a801-4354-9d19-81f04913ea62 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:53.645687 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05082072-eb24-42dc-9ddc-3e7561f8f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:53.646440 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05082072-eb24-42dc-9ddc-3e7561f8f2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.646731 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05082072-eb24-42dc-9ddc-3e7561f8f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.647041 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05082072-eb24-42dc-9ddc-3e7561f8f2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.647785 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05082072-eb24-42dc-9ddc-3e7561f8f2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:53.649661 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05082072-eb24-42dc-9ddc-3e7561f8f2ad admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.663299 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1483/2947] 10.222.0.57 () {58 vars in 1122 bytes} [Wed Sep 7 13:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 07 13:36:53.667830 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.679428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa213c8-d207-4362-a9fa-399742527d73 admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:53.684329 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:53.684960 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.685249 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.685521 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] PATH_INFO: `/v3/projects/f3565f5969a54a769f0a089f3253eb1e/users/12881d9e4dbc4f298a70edc98df0ca23/roles/0f3e19b9978840ecaeca5e5135b809ca` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.700573 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3565f5969a54a769f0a089f3253eb1e, user_id=12881d9e4dbc4f298a70edc98df0ca23, role_id=0f3e19b9978840ecaeca5e5135b809ca)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:53.703568 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:53.819702 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1465/2948] 10.222.0.57 () {60 vars in 1483 bytes} [Wed Sep 7 13:36:53 2022] PUT /identity/v3/projects/f3565f5969a54a769f0a089f3253eb1e/users/12881d9e4dbc4f298a70edc98df0ca23/roles/0f3e19b9978840ecaeca5e5135b809ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:36:53.831538 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] REQUEST_METHOD: `POST` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:53.831865 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:53.832212 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:53.863276 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.auth.core [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] MFA Rules not processed for user `12881d9e4dbc4f298a70edc98df0ca23`. Rule list: `[]` (Enabled: `True`). {{(pid=81819) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:36:53.864524 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:53.896347 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:36:53.927600 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1484/2949] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:36:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:36:53.940287 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:36:53.942057 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:36:54.024645 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df97a6-28aa-4dbb-9496-827cb2c4e6dc admin admin] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:36:54.028676 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27587b66-7880-4b99-914e-fafe09519308 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50d240642e9246dbad42f8e379a60b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:36:54.029308 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27587b66-7880-4b99-914e-fafe09519308 service glance] REQUEST_METHOD: `GET` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:36:54.029610 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27587b66-7880-4b99-914e-fafe09519308 service glance] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:36:54.029884 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27587b66-7880-4b99-914e-fafe09519308 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:36:54.038970 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27587b66-7880-4b99-914e-fafe09519308 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:36:54.040561 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27587b66-7880-4b99-914e-fafe09519308 service glance] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:36:54.050428 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1466/2950] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:36:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:37:03.973099 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=12 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:04.045633 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:21.602227 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:37:21.668546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d6a30-51ba-433f-a8da-313f86505634 None None] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:37:21.674613 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:37:21.675245 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:37:21.675517 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:37:21.675783 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] PATH_INFO: `/v3/users/12881d9e4dbc4f298a70edc98df0ca23` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:37:21.676979 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12881d9e4dbc4f298a70edc98df0ca23)` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:37:21.678934 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:37:21.844591 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12881d9e4dbc4f298a70edc98df0ca23'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:21.845187 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12881d9e4dbc4f298a70edc98df0ca23'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:21.852193 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12881d9e4dbc4f298a70edc98df0ca23'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:21.864439 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12881d9e4dbc4f298a70edc98df0ca23'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:21.865112 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.notifications [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12881d9e4dbc4f298a70edc98df0ca23'} {{(pid=81819) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:21.933312 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1485/2951] 10.222.0.57 () {58 vars in 1224 bytes} [Wed Sep 7 13:37:21 2022] DELETE /identity/v3/users/12881d9e4dbc4f298a70edc98df0ca23 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:37:21.937915 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] REQUEST_METHOD: `POST` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:37:21.938437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:37:21.938437 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:37:21.957461 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.auth.core [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] MFA Rules not processed for user `4baafbf2b11a43589e472cfef377adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81818) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 07 13:37:21.958672 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:37:22.017752 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1467/2952] 10.222.0.57 () {58 vars in 958 bytes} [Wed Sep 7 13:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 07 13:37:22.027502 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:37:22.028989 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:37:22.090170 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bb36d-8a72-4f89-8569-fb7f8ad2f384 admin admin] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:37:22.093876 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57192d85635c489997ea172156dc4695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:37:22.094479 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:37:22.094807 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:37:22.095020 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:37:22.104625 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:37:22.106053 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:37:22.116399 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1486/2953] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:37:22.511756 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] Authenticating user token {{(pid=81818) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:37:22.514460 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.fernet_utils [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81818) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:37:22.526817 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e180a4-fd9a-4087-b8d3-ee3a05a82c02 None None] Validating token access rules against request {{(pid=81818) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:37:22.531643 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4baafbf2b11a43589e472cfef377adf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07da914e24704120962aa1acd6dda617', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81818) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:37:22.532317 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:37:22.532614 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] SCRIPT_NAME: `/identity` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:37:22.532886 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] PATH_INFO: `/v3/projects/f3565f5969a54a769f0a089f3253eb1e` {{(pid=81818) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:37:22.534023 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3565f5969a54a769f0a089f3253eb1e)` {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:37:22.537551 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] RBAC: Authorization granted {{(pid=81818) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:37:22.657781 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3565f5969a54a769f0a089f3253eb1e', 'request_id': 'req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:22.664299 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3565f5969a54a769f0a089f3253eb1e', 'request_id': 'req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:22.670019 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3565f5969a54a769f0a089f3253eb1e', 'request_id': 'req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c'} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:22.760139 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] The token cache is being invalidate because project f3565f5969a54a769f0a089f3253eb1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81818) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 07 13:37:22.760431 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:22.761049 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG keystone.notifications [None req-00ee54bc-3fa7-4253-ba5d-4e44a14d620c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81818) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 07 13:37:22.762578 dv-cinder-804035-50-smb devstack@keystone.service[81818]: [pid: 81818|app: 0|req: 1468/2954] 10.222.0.57 () {58 vars in 1233 bytes} [Wed Sep 7 13:37:22 2022] DELETE /identity/v3/projects/f3565f5969a54a769f0a089f3253eb1e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 07 13:37:32.111546 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:37:32.756923 dv-cinder-804035-50-smb devstack@keystone.service[81818]: DEBUG dbcounter [-] [81818] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81818) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 13:38:33.256722 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] Authenticating user token {{(pid=81819) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 07 13:38:33.258095 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:38:33.395839 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8a9c-9962-49fe-8b2c-27814f38c975 service neutron] Validating token access rules against request {{(pid=81819) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 07 13:38:33.453606 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef26df9666dd4e54aa9c76d4a1aa6cc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae0bcc53fe7047d6ba6b8fc8e5e4bdd7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81819) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 07 13:38:33.454216 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] REQUEST_METHOD: `GET` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 07 13:38:33.454492 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] SCRIPT_NAME: `/identity` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 07 13:38:33.454763 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81819) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 07 13:38:33.456540 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.fernet_utils [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81819) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 07 13:38:33.468322 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 07 13:38:33.469878 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300593f-2a91-41a6-9c13-5964724da4cc service placement] RBAC: Authorization granted {{(pid=81819) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 07 13:38:33.479705 dv-cinder-804035-50-smb devstack@keystone.service[81819]: [pid: 81819|app: 0|req: 1487/2955] 10.222.0.57 () {60 vars in 1365 bytes} [Wed Sep 7 13:38:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 07 13:38:43.475509 dv-cinder-804035-50-smb devstack@keystone.service[81819]: DEBUG dbcounter [-] [81819] Writing DB stats keystone:SELECT=89 {{(pid=81819) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}